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SUMMARY 


Today's  flight  simulators  are  being  called  upon  to  provide 
training  in  obtaining  basic  flight  skills  as  well  as  the  main- 
tenance of  flight  skills  and  system  operation  proficiency  by 
experienced  aviators.  In  some  cases,  the  acceptability  of  the 
flight  simulators  purchased  by  the  U.S.  Navy  has  been  less  than 
desired.  This  study  addressed  three  areas  of  acceptance  testing; 
in  particular,  flying  qualities  and  performance,  cockpit  motion, 
and  visual  simulation.  Proposed  specification  languages  detail- 
ing tests  to  be  performed,  recommended  procedures,  test  criteria 
and  suggested  tolerances  are  included  as  appendixes.  These 
appendixes  may  be  detached  for  independent  use. 
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SECTION  I 
INTRODUCTION 

The  Office  of  the  Secretary  of  Defense  has  directed  the 
services  to  strive  to  achieve  a total  flight  hour  reduction  of 
approximately  25  percent  by  the  end  of  FY  1981.  This  is  to  be 
accomplished  through  continued  development  of  new  training  tech- 
niques and  greater  utilization  of  flight  simulation.  Before 
quantative  substitution  coefficients  relating  simulator  "flight" 
time  to  operational  aircraft  flight  time  can  be  determined, 
techniques  must  be  developed  which  can  be  used  to  certify  a 
level  of  "fidelity"  of  simulation  of  a particular  series  of 
training  devices. 

Today's  flight  simulators  utilizing  visual  display  and  cock- 
pit motion  systems  are  used  to  provide  training  for  the  teaching 
of  techniques  such  as  basic  flying  techniques,  communication 
and  navigation  procedures  and  techniques,  cockpit  procedures, 
and  weapons  system  operating  techniques  to  new  pilots  and  equip- 
ment operators  and  teaching  advanced  techniques  such  as  carrier 
and  field  landing,  airborne  refueling,  air  to  ground  weapon 
delivery  and  air  combat  maneuvering,  as  well  as  maintaining 
proficiency  in  these  areas. 

The  acceptability  of  these  Weapon  System  Trainers  (WST's)  ] 

and  Operational  Flight  Trainers  (OFT's)  by  user  pilots,  has  been  I 

at  a level  much  lower  than  desired.^  Prior  to  the  introduction  ! 

of  visual  display  systems,  the  predominate  criticisms  of  WST's 
and  OFT's  were  in  the  areas  of  control  feel,  engine  dynamics  3 

and  cockpit  motion  cueing.  The  introduction  of  visual  display  j 

systems  added  to  the  complexity  of  the  training  devices  and  i 

added  a new  dimension  of  cue  perception  and  in  addition  high-  | 

lighted  any  errors  in  flying  quality  and  performance  (FQ&P)  j 

simulation  which  may  have  existed,  but  not  previously  noticed  in  j 

simulators  used  as  instrument  trainers.  In  general,  the  number  « 

and  severity  of  the  existing  criticisms  were  not  reduced  by  the 
addition  of  the  visual  display  systems  but  instead  have  been 
enlarged  to  include;  stability  and  control  problems  such  as 
Pilot  Induced  Oscillations  (PIO)  in  the  longitudinal,  lateral 
and  directional  axes;  airframe  reactions  due  to  changes  in  power 
and  configuration;  and  difficulty  in  tracking  tasks  such  as 
carrier  landings  (lineup  and  holding  the  "meatball"),  formation 
flying,  and  weapons  delivery.  As  an  example  of  the  difficulties 
which  can  be  encountered  in  interfacing  a visual  display  system 


Mackie,  Robert  R. ; Kelley,  Gene  R. ; Moe,  Gary  L.  and 
Mecherikoff,  Michael.  "Factors  Leading  to  the  Acceptance  or 
Rejection  of  Training  Devices,"  NAVTRAEQUIPCEN  70-C-0276-1, 
August  1972. 
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to  a flight  simulator,  consider  Device  2F90.  From  the  time  of 
its  delivery  in  1969,  until  September  1972,  it  was  well  received 

2 

and  provided  effective  transfer  of  training. 

After  the  introduction  of  a computer  generated  image  visual 

3 

display  system,  a host  of  problems  became  apparent.  In  the 
case  of  Device  2F90,  a team  effort  by  personnel  from  the  Chief 
of  Naval  Air  Training  (CNATRA) , Training  Wing  Two  (TRAWINGTWO) , 
the  Naval  Air  Test  Center  (NAVAIRTESTCEN) , Naval  Training  Equip- 
ment Center  (NAVTRAEQUIPCEN) , Naval  Education  Training  and 
Program  Development  Center  (NAVEDTRAPRODCEN) , and  Naval  Air 
Systems  Command  (NAVAIRSYSCOM)  providing  funding  was  successful 
in  correcting  the  majority  of  problems  encountered.  The  specific 
nature  of  the  problems  and  their  solutions  are  reported  else- 
where . ^ 

) A large  group  of  problems  were  due  to  a lack  of  fidelity  in 

the  simulation  of  the  TA-4J  flying  qualities  and  performance 
(FQ&P) . The  simulation  was  sufficiently  accurate  for  the 
instrument  training  and  emergency  procedures  training  but  not 
when  used  for  the  visual  tasks.  Clearly,  a methodology  must  be 
' determined  for  performing  acceptance  testing  which  will  aid  in 

achieving  user  acceptance. 

A logical  question  would  follow — What  is  meant  by  the  word  J 

acceptable?  To  the  training  specialist  a device  might  be  accept-  J 

, able  if  a certain  level  of  transfer  of  training  is  attainable; 

after  all,  training  is  the  purpose  of  a training  device.  To  the 
procuring  activity  a device  delivered,  on  time,  per  the  procure- 
ment specifications,  and  within  contract  costs  might  be  accept- 
able. The  user  maintenance  personnel  feel  easy  maintenance  and 
high  reliability  are  key  issues.  Of  course,  the  trainee  wants  to  ’ 

be  trained  in  the  actual  weapon  system  rather  than  a simulator 
(with  the  exception  of  emergency  procedures  training  which  even 
pilots  admit  is  more  suitably  performed  in  the  simulators) . 


TI  Ryan,  L.  E.;  Puig,  J.  A.;  Michel i,  G.  S.;  and  Clarke,  J.  C., 
j "An  Evaluation  of  the  Training  Effectiveness  of  Device  2F90, 

[ TA-4J  Operational  Flight  Trainer:  Part  1:  The  B-Stage," 

NAVTRAEQUIPCEN  Technical  Report  IH-207. 

I 3.  O'Connor,  F.  E.,  CAPT  USN;  Shinn,  B.  J. , Dr.  and  Bunker, 

I W.  M. , Dr.  "Prospects,  Problems,  and  Performance  - A Case  Study 

i.  of  the  First  Pilot  Trainer  Using  CGI  Visuals",  Proceedings  of 

I the  Sixth  Naval  Training  Equipment  Center  and  Industry  Confer- 

f ence,  NAVTRAEQUIPCEN  IH-226,  Nov  13,  1973. 

L 4.  Harris,  W.  T. , "Device  2F90  Flying  Qualities  and  Performance 

^ Evaluation  and  Discrepancy  Correction" , NAVTRAEQUIPCEN  Technical 

Report  IH-245,  September  1975. 
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The  context  of  the  word  acceptable  which  will  be  addressed 
in  this  study  is  in  reference  to  gaining  trainee  acceptance  of 
the  training  device  by  improving  the  fidelity  of  the  FQ&P 
through  improved  acceptance  testing.  This  approach  is  taken 
because  so  little  is  known  regarding  requirements  for  fidelity 
of  simulation  as  a function  of  training  effectiveness  require- 
ments. How  trainee  acceptance  of  a WST  or  an  OFT  is  to  be  gain- 
ed is  a function  of  the  requirements  to  which  the  simulator  was 
procured  and  the  testing  to  which  it  was  subjected.  The  analysis 
of  the  acceptance  procedures  is  the  problem  area  addressed  by 
this  study. 

A statement  of  the  intent  of  this  study  is  in  order.  The 
intent  of  the  study  is  to; 

a.  analyze  the  problems  involved  in  simulator  acceptance 
testing  from  an  engineering  point -of -view. 

b.  recommend  a testing  methodology  vdiich  would  reduce  the 
problems. 

c.  point  out  areas  of  difficulty  involved  in  using  the 
recommended  methodology. 
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SECTION  II 
BACKGROUND 

When  systems  are  as  complex  and  expensive  as  modern  WST's, 
it  is  not  too  surprising  that  the  test  program  to  which  they 
must  be  subjected  would  also  be  quite  complex.  The  Department 
of  Defense  requires  that  all  training  devices  be  procured  using 

MIL-T-23991  as  a guide.  Many  exciminations  and  tests  to  be 
applied  to  training  devices  are  therein  specified;  these  exami- 
nations and  tests  are  shown  in  Tables  1 and  2. 

This  specification  addresses  general  construction,  workman- 
ship and  reliability  of  training  devices  but  no  detail  is  given 
as  to  what  or  how  functional  testing  is  to  be  performed.  The 
U.S.  Navy  has  seen  fit  to  write  another  general  specification 

MIL-T-82335 which  addresses  the  requirements  for  fixed-wing 
WST's  and  OFT's.  This  specification  refers  to  MIL-T-23991  for 
all  quality  assurance  provisions.  The  specification,  last 
revised  in  1969,  is  currently  being  expanded  to  include  testing 
and  rotary  wing  aircraft  simulators.  The  U.S.  Air  Force  has 

also  written  its  aircraft  trainer  specification^  v^ich  includes 
a rather  detailed  Quality  Assurance  Provisions  section  listing 
tests,  test  methods  and  conditions  for  evaluating  some  Computer, 
Flying  Qualities  and  Performance,  Engine  Performance,  Cockpit 
Motion  and  Visual  Display  tests.  Table  3 lists  the  test  cate- 
gories called  out  in  MIL-T-9212. 

Navy  Testing  Experience 

The  Naval  Training  Equipment  Center  (NAVTRAEQUIPCEN)  has  had 
extensive  experience  in  acceptance  testing  of  WST's  and  OFT's. 

In  the  early  years  of  simulator  testing,  a need  was  recognized 
for  standardizing  the  procedures  involved.  As  early  as  1952,  a 

O 

specification  existed  vdiich  detailed  the  testing  of  OFT's.  The 
specification  contained  tests  to  be  performed,  test  methods, 
variables  to  be  recorded,  test  conditions,  test  configurations 
and  tolerances  to  be  met.  Table  4 provides  an  outline  of  the 
test  areas  required  by  the  Special  Devices  Center  in  1952. 


5~!  Anon;  MIL-T-23991,  Military  Specification  - "Training 
Devices,  Military;  General  specification  for." 

6.  Anon;  MIL-T-82335,  Military  Specification  - "Trainer,  Fixed- 
Wing,  Flight;  General  Specif ication  for." 

7.  Anon;  MIL-T-9212,  Military  Specification  - "Trainer,  Flight 
Simulator,  Aircraft,  General  Requirements  for." 

8.  Anon;  SDC  911-600,  Department  of  the  Navy  Office  of  Naval 
Research  - Special  Devices  Center,  General  Specification  for 
Testing  of  Operational  Flight  Trainers  and/or  Tactics  Trainer 
Simulation,  15  Aug  1952. 
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This  specification  remained  in  effect  for  several  years.  The 
testing  program  required  by  the  specification  was  time  consum.ing 
and  aircraft  had  changed  considerably  since  its  introduction, 
hence,  in  the  late  1950 's  the  Naval  Training  Device  Center 
(NAVTRADEVCEN) , which  superseded  the  Special  Devices  Center,  con- 
tracted with  the  Cornell  Aeronautical  Laboratory  to  devise  a 
testing  methodology  which  would  adequately  test  the  OFT ' s and  yet 
be  much  faster  in  implementation  than  the  procedures  of  SDC 
911-600.  The  results  of  the  research  appeared  in  a series  of 

reports^ ' directed  toward  the  testing  of  analog  com- 
puter equipped  OFT's  and  WST's.  Two  important  products  of  the 
research  appeared  in  the  first  of  these  reports,  NAVTRADEVCEN 
318-1.  Recommended  revisions  to  NAVTRADEVCEN  specification 

14 

911-600A  were  incorporated  into  another  specification  , 
NAVTRADEVCEN  31-610,  v^ich  superseded  SDC  911-600.  The  changes 
recommended  were  not  extensive  with  regard  to  which  variables 
and  parameters  were  to  be  investigated.  Another  im.portant  pro- 
duct of  Newell's  research  was  a grouping  of  tests  which  could  be 
performed  simultaneously.  However,  this  simultaneous  data 
gathering  required  a considerable  amount  of  engineering  analyti- 
cal talent  was  required  to  interpret  correctly  the  results  of 
the  testing  program.  In  NAVTRADEVCEN  318-1*  Newell  said  "The 
traces  should  be  analyzed  by  the  engineering  personnel  who  are 
familiar  with  both  simulator  design  techniques  and  airplane 
response  characteristics.  A thorough  knowledge  of  airplane 
dynamics,  computers  and  transient  and  frequency  response  techni- 
ques should  be  prerequisites  for  the  task  of  evaluating  a flight 
simulator."  This  statement  is  as  true  today  as  it  was  in  1959. 


W.  Newell , Fredrick  D. ; NAVTRADEVCEN  318-1,  Final  Report 
"Dynamic  Test  Program  for  Weapons  System  Trainers",  April  1959, 
(AD-228942),  Unclassified. 

10.  Newell,  Fredrick  D. ; Schelhorn,  Arno  E. ; NAVTRADEVCEN  318-2, 

Final  Report,  Phase  III:  "Dynamic  Test  Program  for  Weapon  System 

Trainers,"  March  1961,  (AD-323180),  Confidential. 

11.  Schelhorn,  Arno  E.;  NAVTRADEVCEN  318-3,  "Preliminary  Design 
Report  for  NTEC  Research  Model  Tech  Equipment,"  February  1960, 
Unclassified . 

12.  Newell,  Fredrick  D.;  Schelhorn,  Arno  E.;  NAVTRADEVCEN  318-4, 

"Summary  Report  Phase  IV:  Dynamic  Test  Program  for  Weapon 

Systems  Trainers,"  June  1961,  (AD-262667),  Unclassified. 

13.  Newell,  Fredrick  D. ; Schelhorn,  Arno  E.;  NAVTRADEVCEN  318-5, 

"Final  Report  Addendum:  Application  of  Dynamic  Test  Techniques 

to  Weapon  System  Trainers,"  September  1960,  (AD-484396), 

Unclassified . 

14.  Anon:  U.S.  Naval  Training  Device  Center  31-610,  "General 
Specification  for  Functional  Test  Requirements  - Fixed  Wing 
Aircraft  - Weapon  System  Trainers  (Flight)",  30  August  1963. 

* See  Reference  9. 
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Table  5 details  the  primary  areas  currently  relevant  in 
simulator  acceptance  testing. 

The  areas  of  Maintainability,  Reliability  and  Electromagnetic 
Interference  are  not  included,  because  they  are  well  defined  and 

established  by  Military  Standards . 

There  are  areas  of  testing  shown  on  Table  5 vdiich  are  also 
relatively  well  defined  with  respect  to  test  methods  and  other 
than  mentioning  their  existence  will  not  be  treated  further 
herein.  Such  areas  include;  computer  hardware  diagnostics, 
which  are  supplied  by  the  computer  manufacturer;  computer  soft- 
ware requirements  and  system  diagnostics  are  delineated  in 

another  military  standard^®;  Navigational  and  tactical  simulated 
systems,  which  are  best  tested  by  skilled  operators  evaluating 
the  equipment;  Instructor  functions.  Computer  Aided  Instruction 
and  mission  playback  functions,  tend  to  be  best  evaluated  sub- 
jectively. 

There  are  then  three  major  areas  of  a simulation  system 
evaluation  process  which  need  to  be  considered  and  which  consti- 
tute the  focus  of  this  research  effort.  They  are; 

a.  Flying  Qualities  and  Performance  (FQ&P)  including  engine 
performance . 

b.  Cockpit  Motion  (CM)  systems. 

c.  Visual  Display  (VD)  systems. 


I 

l 


r 


15 . Anon;  MIL-STD-470,  Military  Standard;  Maintainability  Pro- 
gram Requirements  (For  Systems  and  Equipments) . 

16.  Anon;  MIL-STD-471,  Military  Standard;  Maintainability 
Demonstration . 

17.  Anon;  MIL-STD-781,  Military  Standard;  Reliability  Tests, 
Exponential  Distribution. 

18.  Anon;  MIL-STD-785,  Military  Standard;  Requirements  for 
Reliability  Program  (For  Systems  and  Equipments) . 

19.  Anon;  MIL-STD-826,  Military  Standard;  Electromagnetic 
Interference  Test  Requirements  and  Test  Methods. 

20.  Anon:  MIL-STD-876  (USAF) , Military  Standard;  Digital  Com- 
putation Systems  for  Real-time  Training  Simulators. 
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Simulation  Fidelity  Problems 

There  are  several  reasons  why  the  simulation  would  not  be  of 
sufficient  fidelity.  These  reasons  are  shown  in  Table  6.  Most 
of  these  reasons  appear  to  be  easily  noted  a priori . However, 
in  practice,  they  are  often  not  recognized  until  ac^ceptance 
testing  has  been  conducted  and  hence  constitute  a major  reason 
for  performing  acceptance  testing. 

Presently  Utilized  Methods  of  Training  Simulator  Testing 

Commercial,  Air  Force,  Army,  Navy  and  Marine  training  flight 
simulator  acceptance  procedures  were  investigated  in  this  study. 
Prior  to  1974,  the  various  users  had  been  acceptance  testing 
their  training  devices  in  a similar  fashion.  The  simulator 
manufacturer  recommended  some  tests  of  his  simulator's  FQ&p, 

CM  and  VD  systems,  as  presented  in  some  test  document.  These 
tests  were  reviewed  and  approved  with  changes  deemed  necessary 
) by  user  acceptance  personnel.  The  simulator  was  then  tested  to 

the  approved  test  document.  The  next  portion  of  the  acceptance 
procedure  usually  involved  a subjective  evaluation  by  one  or 
more  experienced  pilots  who  flew  various  tasks  in  the  simulator 
and  provided  comments  of  discrepancies  to  the  simulator  manufact- 
urer for  corrective  action.  The  corrective  action  was  then 
re-evaluated  by  the  pilots  and  the  iterative  process  would 
continue.  A level  of  acceptability  would  be  attained  and  the 
simulator  would  be  accepted.  The  proceeding  testing  can  be  pre- 
sented as  three  stages: 

a.  Factory  testing  - Verifying  that  the  simulator  does  what 
the  acceptance  procedure  delineates  the  simulator  to  do. 

b.  On  site  testing  - Verifying  that  the  simulator  still  does 
what  it  did  at  the  factory  after  the  equipment  has  been  shipped 
to  the  operational  site. 

c.  Subjective  evaluation  of  the  FQ&p  by  user  pilots. 

The  commercial  users  would  continue  the  iterative  process 
for  some  time  (a  year  of  additional  engineering  testing  modifi- 
cation and  development  was  not  uncommon)  until  their  key 
acceptance  pilots  were  satisfied  with  the  simulated  FQ&p. 

After  1974,  the  Navy  and  Marine  Corps  adopted  a different 
procedure.  The  training  simulators  were  accepted  using  test 
pilots  from  either  the  NAVAIRTESTCEN  or  from  the  manufacturer  of 
the  simulated  aircraft  (e.g.,  Lockheed  test  pilots  were  used  to 
evaluate  the  P-3  simulators)  to  gather  specific  engineering 
FQ&P  test  data  and  comparing  the  simulators  FQ&P  test  data 
to  the  actual  aircraft  FQ&P  data.  For  the  FQ&P  testing,  the 
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tests  which  were  conducted  and  test  methods  used  were  those 
taught  by  the  Navy  at  the  U.S.  Navy  Test  Pilot  School  (USNTPS) . 

21  22 

These  test  procedures  are  detailed  in  the  textual  material  ' 
used  in  that  school's  coursework.  Similar  techniques  cind  theory 

2 3 

are  described  by  the  U.S.  Air  Force  in  their  test  pilot  manual 

The  acceptance  (or  verification)  testing  procedure  used  by 
the  Research  and  Engineering  development  simulator  personnel  to 
verify  the  FQ&P  of  a simulator  are  somewhat  different  than 
those  usually  found  in  training  and  commercial  simulators. 

Engineering  simulators,  as  used  in  aircraft  development  are 
usually  initially  designed  using  wind  tunnel  and  empirical  data 
obtained  prior  to  the  aircraft's  first  flight  and  are  modified 
using  aircraft  test  data  as  it  becomes  available.  The  tests 
conducted  to  verify  the  FQ&P  are  of  the  type  used  by  the  Navy 
today,  i.e.  , the  standard  measures  taken  during  aircraft  evalua- 
tion are  repeated  for  the  simulation  and  compared  to  the  corres- 
ponding aircraft  data. 

There  is  some  work  being  done  in  research  directed  towards 
automating  the  process  of  acceptance  testing  the  FQ&P  simula- 
tion of  a training  device.  This  line  of  research  is  being  con- 

24 

ducted  by  Goodyear  Aerospace  Corporation  and  by  the  Air  Force 
Human  Resources  Laboratory. 

Cockpit  miotion  and  visual  display  systems  are  almost  exclus- 
ively accepted  using  subjective  evaluations.  A notable  exception 

24 

to  the  above  statement  is  a recent  evaluation  effort  (called 
Project  2235)  performed  by  the  US  Air  Force  in  which  four  state- 
of-the-art  visual  display  system  equipped  simulators  were  eval- 
uated for  their  effectiveness  in  providing  training  for  the 


21.  Langdon,  S.  D.  LCDR  USN,  "Fixed  Wing  Stability  and  Control 
Theory  and  Flight  Test  Techniques"  Naval  Test  Pilot  School  Flight 
Test  Manual,  USNTPS-FTM-No  103,  Aug.  1969. 

22.  Small,  S.  M. , LCDR  USN  and  Prueher,  J.  W.,  "Fixed  Wing 
Performance  Theory  and  Flight  Test  Techniques,"  Naval  Test  Pilot 
School  Flight  Test  Manual  USNTPS-FTM-No  104,  July  1972. 

23.  Anon:  "Stability  and  Control",  FTC-TIH-64-2004 , USAF  Aero- 

space Research  Pilot's  School  Rev.  Nov.  1964. 

24.  Jacobs,  W.  B. ; "Automated  Simulator  Test  and  Checkout", 
Goodyear  Engineering  Report  GER  16011,  Jan.  1974.  (Ref.  IR  & D 
Project  No.  0509-73-D5) . Proprietary. 

25.  Hutton,  D.  P.;  Burks,  D.  K. ; Englehart,  J.  D. ; Wilson  Jr., 

J.  M. ; Romaglia,  F.  J. ; and  Schneider,  A.  J. ; "Final  Report 
Project  2235  - Air-to-Ground  Visual  Simul  ion  Demonstration" 

P.E.  64227F,  October  1976. 
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conventional  and  tactical  air-to-ground  weapons  delivery  tasks. 
This  evaluation  effort  consisted  of  two  different  types  of 
evaluation.  The  first  was  a technical  evaluation  of  the  various 
display  systems'  capabilities  in  terms  of  engineering  performance 
measures.  The  second  type  of  evaluation  was  a subjective  eval- 
uation of  how  well  each  of  the  systems  tested  were  able  to  pro- 
vide the  cues  necessary  for  accomplishing  the  weapons  delivery 
tasks.  The  technical  evaluation  phase  is  of  particular  interest 
in  that  four  different  types  of  systems  were  tested  including 
Computer  Generated  Image  (CGI)  systems,  Terrain  Model  Board  (TMB) 
systems  and  combinations  of  the  systems.  The  technical  testing 
program  of  this  project  is  summarized  in  Table  7.  The  test 
set-ups  are  shown  in  figure  1. 


The  types  of  technical  tests  chosen  were  well  suited  to  the 
intended  purpose.  For  example,  The  Modulation  Transfer  Function 
(MTF)  provides  information  on  the  capability  of  the  system  to 
display  detail;  the  photometer  measurements  provide  an  additional 
measure  of  scene  detail,  display  capability  and  a measure  of 
scene  luminance;  the  distortion  tests  provide  information  on 
perspective  errors,  distortion  and  field  of  view.  The  observer 
camera  technique  used  was  developed,  described,  and  verified  by 


26  27  28  29 

Harshbarger  et  al  in  the  mid  196 O' s ' ' ' . The  technique 

provides  a uniform  method  of  comparison  of  various  systems  as 
long  as  a "standard"  observer  camera  is  used. 

The  U.S.  Navy  also  is  involved  in  the  procurement  of  and 


testing  of  VD  systems.  Driskell  provides  , among  other  things,  ^ 
a specification  language  intended  to  serve  as  a guide  in  pro-  j 
curing  of  and  acceptance  testing  of  VD  systems.  Although  slanted  1 
tov/ard  TMB  Systems  primarily,  the  recommended  tests  are  also  j 
meaningful  for  Computer  Generated  Imaging  (CGI)  VD  systems.  The  * 
tests  recommended  are  shown  in  Table  8.  \ 


26 . Harshbarger,  John  H.;  ^Gill , Arthur  T.  ; "Development  of 
Techniques  for  Evaluation  of  Visual  Simulation  Equipment", 
AMRL-TDP.-64-4  9,  August  1964  . 

27.  Harshbarger,  John  H. ; "Test  and  Evaluation  of  Electronic 
Image  Generation  and  Projection  Devices  - Volume  I - Evaluation 
Technique",  AMRL-TR-65-116 , Vol  I,  August  1965. 

28.  Harshbarger,  John  H.;  Basinger,  James  D. ; "Test  and  Evalua- 
tion of  Electronic  Image  Generation  and  Projection  Devices- Volume 
II-Evaluation  of  Television  Systems",  AMRL-TR-65-116,  Vol  II, 
November  1965. 

29.  Harshbarger,  John  H.;  Basinger,  James  D. ; "Test  and  Evalua- 
tion of  Electronic  Image  Generation  and  Projection  Devices  - 
Volume  III  - Evaluation  of  Projection  Screens",  AMRL-TR-65-116, 
Vol  III,  December  1965. 

30.  Driskell,  Carl  R.,  "Capabilities  in  Wide  Angle  Visual  Tech- 
nology", NAVTRAEQUIPCEN  IH-237,  December  1974  . 
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For  more  than  thirty  years,  a search  has  continued  for  a 
universally  recognized  criterion  of  merit  which  may  be  used  to 
objectively  evaluate  the  image  content  of  a display.  Of  course 
this  area  of  endeavor  is  strongly  related  to  the  determination 
of  an  objective  measure  of  display  resolution.  Lindenberg 

reported^^  that  of  the  three  most  popular  techniques  for  deter- 
mining system  resolution,  the  Modulation  Transfer  Function  (MTF) 
is  the  most  convenient  primarily  due  to  its  advantages  in  obtain- 
ing a system  MTF  as  the  product  of  the  component  MTF's  and  in 
being  able  to  determine  the  visual  acuity  limit  of  a system.  Two 
32  33 

investigations  ' report  high  correlations  between  the  Modula- 
tion Transfer  Function  Area  (MTFA) , (defined  as  the  area  between 
the  MTF  curve  and  the  visual  threshold  Modulation  Curve),  and 
both  objectively  measured  information  extraction  cind  a subjective 
image  quality  rating. 

Problems  with  the  Presently  Used  Methods  of  Simulator  Testing 

Several  problems  exist  with  the  methods  of  simulator  accept- 
ance testing  in  use  today.  Consider  the  objective  portions  of 
the  testing  programs,  that  is,  the  portion  of  the  testing  program 
in  which  specific  measurements  are  made  and  compared  to  the  test 
criteria  provided  by  the  simulator  manufacturer  or  the  procuring 
activity.  The  nroblem  is  in  not  using  aircraft  data  as  the 
criteria  of  merxt  for  the  acceptance  testing.  The  fidelity 
assessment  should  determine  how  like  the  airc raft  performance 
the  simulated  aircraft  performance  is.  Current  testing  philoso- 
phy uses  the  engineering  development  simulation  data  and  merely 
proves  that  the  solutions  of  equations  obtained  on  one  computer 
are  the  same  as  those  obtained  on  another. 


31 . Lindenberg”  Klaus , "Objective  Evaluation  Method  for  Simula- 
lated  Visual  Scenes  - Preliminary  Analysis",  NAVTRAEQUIPCEN 
TN-4  7,  August  1976. 

32.  Borough,  H.  C.  ; Fallis,  R.  F.;  Wamock,  R.  H.;  and  Britt, 

J.  H.;  "Quantitative  Determination  of  Image  Quality,"  Boeing 
Company  Report  D2-114058-1,  May  1967. 

33.  Klingberg,  C.  S.;  Elsworth,  C.  S.;  and  Fillean,  C.  R. ; 
"Image  Quality  and  Detection  Performance  of  Military  Photo 
Interpreters,"  Boeing  Coitpany  Report  D162-10323-1,  September 
1970. 
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Another  set  of  objective  problems  appears  with  the  observer 
camera  technique  used  in  obtaining  the  Modulation  Transfer 

34 

Function  (MTF)  of  Visual  Display  systems.  The  first  limitation 
is  that  it  requires  a special  camera  of  high  sensitivity  (since 
most  visual  display  systems  encountered  in  simulation  have 
relatively  low  brightness)  and  a linear  brightness  response.  The 
second  limitation  is  that  the  technique  is  very  awkward  to  use  in 
making  color  display  measurements.  Another  factor  for  consider- 
ation is  the  level  of  skill  required  by  the  test  personnel  for 
data  teiking  cind  analysis.  Finally,  it  can  be  difficult  to  locate 
the  required  instrumentation  at  the  pilots  eye  point  in  the 
simulator. 

The  problems  associated  with  the  subjective  evaluations  are 
well  known  to  personnel  associated  with  acceptance  testing  and 
model  construction.  They  include: 

a.  Accomodation  - subjective  appraisals  of  a simulation  will 
vary  as  the  evaluator  becomes  accustomed  to  the  simulation  being 
evaluated.  This  is  especially  noticeable  when  FQ&P  character- 
istics are  being  evaluated.  Interestingly,  the  better  pilots 
accomodate  even  easier  than  less  capable  pilots  and  in  short 
order  "learn"  to  fly  the  simulator  and  thereby  lose  their  objec- 
tivity. 


b.  Multiple  subjective  opinions  of  exactly  the  same  simula- 
tion will  indicate  different  degrees  of  fidelity  of  the  simula- 
tion. Again,  particularly  in  the  evaluation  of  the  control 
loading  (force  feel)  system.  This  situation  exists  if  the 
multiple  subjective  opinions  are  offered  by  the  same  evaluator 
at  different  times  due  to  fatigue,  accomodation,  external  stress 
situations  (health,  emotional  stress,  etc.)  or  for  unknown 
reasons.  This  problem  is  further  complicated  if  multiple  sub- 
jective opinions  are  offered  by  multiple  evaluators  each  per- 
forming multiple  evaluations. 

c.  It  is  generally  difficult  to  interpret,  in  engineering 
terms,  the  subjective  opinions  offered  vhen  corrective  efforts 
are  required,  i.e.,  correcting  some  area  of  simulation  provided 
by  the  mathematical  model.  Comments  such  as  "The  controls 
didn't  feel  right"  are  common. 


34 . Ewart,  Ronald  B.;  Harshbarger , John  H. ; "Measurement  of 
Flight  Simulator  Visual  System  Performance,"  Journal  of  the 
Society  of  Photo-Optical  Instrumentation  Engineers  (SPIE)  Vol  59 
(1975)  Simulators  and  Simulation. 
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d.  Not  all  areas  of  simulation  are  sufficiently  toleranced 
in  the  procurement  documents  such  as  MIL-T-82335,  MIL-T-9212, 
MIL-T-23991,  but  even  the  areas  vhich  are,  present  considerable 
difficulty  in  determining  acceptability  vhen  the  opinions  offer- 
ed are  subjective.  For  example,  an  opinion  might  be  that  the 
fuel  flow  is  too  high  at  .8  Mach  and  35,000  feet  altitude.  The 
fuel  flow  is  allowed  to  be  somevhat  in  error,  as  defined  by  the 
tolerances,  and  an  objective  measurement  is  required  to  ascertain 
whether  the  simulation  is  within  tolerance. 

Another  problem  area  is  in  the  testing  of  cockpit  motion  and 
visual  display  systems.  These  systems  have  been  acceptance  test- 
ed primarily  using  subjective  evaluations  rather  than  objective 
measures.  This  constitutes  a problem  area  because  the  newer 
procurement  specifications  cite  cockpit  motion  and  visual  display 
system  requirements  in  terms  of  engineering  performance  measures. 
These  performance  measures  must  be  verified  to  determine  the 
satisfaction  of  contractual  obligations.  The  testing  of  these 
) engineering  performance  measures  should  be  objective,  treating 

the  systems  to  be  tested  as  servo-mechanisms  and  subjecting  them 
to  the  usual  "servo"  type  performance  testing  such  as  static  and 
dynamic  performance  and  interface  performance.  The  cueing  de- 
livered by  a cockpit  motion  system  should  be  tested  both  object- 
' ively  and  subjectively.  This  requirement  is  made  manifest  be- 

cause the  cue  delivered  by  a cockpit  motion  system  is  a function 
of  both  the  hardware  capability  and  the  manner  the  platform  is 
driven.  Since  there  is  no  universally  recognized  drive  algorithm 
(and  associated  gains  and  frequencies)  there  is  no  such  concept 
, as  the  "correctness"  of  the  cues  provided.  In  fact,  there  is 

some  controversy  as  to  exactly  vdiat  constitutes  a cue.  Hence 
a subjective  appraisal  is  still  required. 

The  objective  measurements  are  necessary  to  verify  that 
smoothness,  cue  synchronization  and  orientation  are  within  toler- 
ances. Subjective  appraisals  are  necessary  to  evaluate  the 
' effects  of  such  accelerations  as  those  caused  by  buffets,  stalls 

and  spins. 

, Finally,  the  task  of  procuring  flight  simulators  for  use  by 

the  Fleet  is  complicated  by  several  factors.  These  factors  com- 
prise several  general  areas  including: 

a.  The  current  test  procedures  used  do  not  necessarily  have 
anything  to  do  with  gaining  or  insuring  acceptance  by  the  user 
Fleet  pilots. 

b.  The  current  test  procedures  do  not  adequately  test  a 
training  simulator.  In  particular,  the  areas  of  ground  and 
airborne  handling,  engine,  cockpit  motion  and  visual  simulation 
are  insufficiently  tested. 
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c.  The  Fleet  Project  Team  (FPT)  is  not  satisfied  with  the 
current  acceptance  testing  procedures. 

d.  Exactly  when  should  the  flight  simulator  be  purchased; 

If  purchased  prior  to  the  construction  of  the  aircraft,  insuffi- 
cient data  exists  to  build  or  test  the  simulator.  If  the 
simulator  is  procured  after  fleet  introduction,  the  squadrons 
have  no  tool  to  train  the  pilots  on  until  several  years  after 
they  have  the  operational  aircraft. 

e.  The  personnel  assigned  to  the  FPT  change,  often  during 
a simulator  procurement. 

f.  There  is  some  question  as  to  exactly  which  documents 
should  be  used  as  acceptance  criteria. 


) 
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• SECTION  III 

STATEMENT  OF  THE  PROBLEM 

The  problem  addressed  by  this  report  is  that  of  defining  a 
testing  methodology  vdiich  will  assess  the  fidelity  of  FQ&P, 
cockpit  motion,  cind  visual  display  simulation  in  terms  of  engi- 
neering performance  measures.  The  methodology  should: 

a.  Be  as  free  of  the  problems  associated  with  the  currently 
used  methods  as  possible. 

b.  Be  repeatable. 

c.  Have  sufficient  aircraft  reference  data  available  or 
obtainable. 

d.  Lead  to  greater  pilot  acceptance  of  the  device  when  the 

) test  criteria  have  been  met. 

e.  Be  easily  implemented. 

f.  Be  uniformly  applicable  for  all  types  of  fixed  wing 

' simulators. 

g.  Recognize  the  tolerances  encountered  in  aircraft  co- 
efficient data,  performance  data  and  in  simulation  computing 
inaccuracies. 

' h.  Lead  to  a fidelity  assessment  which  is  of  sufficient 

quality  as  to  "certify"  that  the  simulation  provides  the  same 
FQ&P  measures  (within  tolerance  limits)  as  the  operational 
aircraft. 

Since  the  ultimate  application  of  the  recommended  testing 
methodology  is  that  of  aiding  in  the  procurement  process  in 
general,  and  acceptance  testing  of  training  simulators  in 
particular,  the  methods  developed  must  be  stated  in  a form  suit- 
able for  incorporation  in  a trainer  specification. 
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SECTION  IV 
DISCUSSION 

The  emphasis  of  this  effort  was  placed  on  satisfying  the 
often  mentioned  areas  of  user  complaint  such  as: 

a.  Handling  qualities  ("The  trainer  doesn't  feel  right") 

b.  Engine  simulation 

c.  Areas  which  cause  mission  nonperformance  - such  as  pilot 
induced  oscillations  or  stable  instrument  trainers  which  are  not 
"flyable"  when  mated  to  visual  display  systems. 

d.  Cockpit  motion  simulation 

These  problem  areas  were  addressed  by  first  identifying  the 
characteristics  which  distinguish  an  aircraft  to  the  pilot.  That 
is,  identify  what  a pilot  perceives,  while  operating  an  aircraft, 
that  indicates  to  him  that  he  is  flying  a specific  aircraft. 

These  areas  turned  out  to  be  those  parameters  detected  at  the 
man-machine  interface.  This  interface  includes  such  areas  as; 

a.  Visually  observable  indications 

b.  Control  feel  - displacements,  rates  and  forces 

c.  Acceleration  cueing  - cockpit  motion  systems. 

d.  Visual  display  systems 

The  approach  taken  to  provide  the  required  testing  method- 
ology was  straight  forward.  The  interface  between  man  and 
machine  was  chosen  as  the  focus  of  the  testing  effort.  The 
testing  effort  was  directed  toward  testing  those  areas  of  the 
simulation  with  which  the  pilot  is  subconsciously  or  consciously 
aware.  Control  loading  (force,  feel  and  deflection),  power 
lever  deflection  and  aircraft  dynamics  are  areas  that  tend  to  be 
noticed  at  the  subconscious  awareness  level.  Aircraft  trim 
settings,  pitch  angle,  angle  of  attack  and  instrument  indications 
in  general  tend  to  be  noticed  at  the  conscious  awareness  level. 

The  problem  acceptance  personnel  encounter  is  to  determine 
acceptance  techniques  vd-iich  will  allow  a rapid  assessment  of 
those  characteristics  that  distinguish  an  aircraft  to  the  pilot. 
It  is  not  sufficient  to  verify  that  a simulator  performs  as 
described  by  the  mathematical  model.  The  overall  simulation 
system  including  simulated  control  feel,  flying  qualities  and 
performance,  cockpit  motion  and  visual  systems  must  be  tested 
for  compliance  with  the  actual  aircraft  characteristics. 
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SECTION  V 
RESULTS 

The  products  of  this  research  appear  as  a collection  of 
appendixes  to  this  report.  They  are  written  in  the  general 
format  of  a specification  and  are  numbered  individually  so  as 
to  be  separately  removable  for  use  by  various  testing  and  pro- 
curement personnel. 

Appendix  A deals  with  the  testing  of  the  fidelity  of  Flying 
Qualities  (handling  qualities)  and  performance  and  engine  per- 
formance. In  particular,  the  categories  shown  in  Table  9 are 
discussed  in  Appendix  A.  For  each  of  these  categories,  test 
methods,  conditions,  equipment  and  configurations  are  recommend- 
ed. The  contents  of  Appendix  A are  being  incorporated  into  the 
revision  of  MIL-T-82335  to  be  known  as  MIL-T-92032. 

Appendix  B deals  specifically  with  testing  of  cockpit  motion 
systems.  Areas  of  testing  recommended  are  shown  in  Table  10. 

The  contents  of  Appendix  B are  currently  planned  for  intro- 
duction in  a MIL  STD  for  cockpit  motion  systems. 

Appendix  C treats  the  testing  of  visual  display  systems. 

Areas  of  testing  discussed  are  denoted  in  Table  11. 

In  general  the  testing  program  that  has  been  recommended  in 
the  appendixes  employs  a testing  methodology  which  addresses 
end-product  performance.  For  example,  rate  of  climb  testing 
indirectly  verifies  lift,  drag,  angle  of  attack,  flight  path 
angle,  airspeed,  altitude,  gross  weight  cind  thrust  calculations 
using  as  a criterion  of  merit  a published  measure  of  aircraft 
performance.  This  type  of  testing  is  well  suited  for  performing 
acceptance  testing  but  obviously  is  not  the  kind  of  testing 
methodology  one  would  employ  to  determine  the  exact  nature  of  a 
problem  encountered  when  the  rate  of  climb  criterion  has  not  been 
properly  simulated.  The  "trouble  shooting"  type  of  testing 
involves  careful  engineering  measurements  of  the  many  variables 
responsible  for  the  calculation  of  the  rate  of  climb.  The  data 
for  these  tests  is  often  comprised  of  wind  tunnel  and  engineering 
estimates,  and  hence  may  be  suspect,  furthermore,  the  implemen- 
tation of  the  mathematical  model  or  the  mathematical  model  itself 
might  be  in  error. 
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Sequencing  of  Testing 

The  specific  ordering  of  tests  shown  in  the  appendixes  is 
that  of  convenience.  It  is  merely  a grouping  of  tests  by  area 
of  test  and  static  or  dynamic  type  of  testing.  Obviously  there 
is  no  single  optimum  technique  for  collectively  performing  the 
testing.  Considering  the  testing  of  FQ&p,  it  does  appear  that 
the  testing  is  more  readily  accomplished  by  separating  it  into 
several  general  categories  such  as  longitudinal,  lateral-direc- 
tional and  portions  of  the  performance  with  portions  of  engine 
performance  constituting  the  final  category.  It  also  appears 
that  an  inverse  relationship  exists  between  the  amount  of  com- 
bining of  static  and  dynamic  testing  which  can  be  performed  and 
the  level  of  knowledge  of  the  engineering  test  personnel  in  the 
areas  of  aerodynamics,  computer  simulation  techniques,  transient 
and  frequency  response,  and  analytical  techniques.  That  is,  the 
more  information  which  is  to  be  extracted  from  the  smallest 
amount  of  recorded  data  and  control  inputs  requires  more  and 
more  post-simulator-test  data  analysis.  Hence  a sensible  trade- 
off must  be  made  which  considers  level  of  skill  of  testing 
personnel,  cost  of  testing  time  (including  post  test  data 
analysis) , and  the  nature  and  format  of  the  aircraft  data  which 
is  to  be  used  as  acceptance  test  criteria.  Given  that  some  such 
selection  can  be  made,  one  such  "optimum"  sequencing  of  tests 
for  the  FQSP  testing  was  reported  by  Newell  in  NAVTRADEVCEN 
318-1*.  The  published  sequencing  is  still  as  good  as  any  for  the 
testing  of  portions  of  the  performance  envelope;  certain  cockpit 
motion  and  visual  display  system  and  added  engine  testing  can  be 
combined  with  the  FQ&P  testing.  Table  12  summarizes  this 
optimum  seqv'.encing  of  tests  as  updated  for  digital  simulations, 
cockpit  motion  and  visual  display  system  dynamic  testing.  Notice 
that  Table  12  is  quite  optimum  with  regard  to  establishing  the 
effectiveness  of  the  digital  computer  solution  of  a specific 
mathematical  model;  however,  the  transition  phases  of  a mission 
such  as  take-off,  landing,  ground  handling,  buffet,  etc.  are  not 
verified.  Further  notice  that  it  is  necessary  to  utilize  the 
services  of  an  experienced  test  pilot  to  draw  the  final  compari- 
sons to  actual  aircraft  performance.  The  tests  as  outlined  in 
Table  12  represent  a maximum  effort  in  dynamic  testing  leading  to 
the  minimum,  of  actual  simulator  utilization  time  for  testing. 

The  amount  of  time  spent  in  reducing  the  data  and  the  chance  of 
error  in  the  data  reduction  are  considerable.  In  the  comparison 
of  overall  simulator  testing  and  data  reduction,  the  groupings, 
as  set  forth  in  the  appendixes  using  computerized  data  recording 
and  test  aids  such  as  Mach  and  altitude  hold  and  auto  trim,  are 
more  direct,  easier  to  conduct  and  faster  than  the  maximum 
dynamic  test  effort. 


* See  Reference  9. 
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Simulation  Tolerances 

The  problem  usually  encountered  in  simulator  procurement  and 
acceptance  testing  is  not  to  troubleshoot  an  existing  simulation 
but  rather  to  determine  the  satisfaction  of  contractual  obliga- 
tions involving  levels  of  simulation  fidelity  as  detailed  in  some 
specification.  Before  any  determination  of  satisfaction  of 
contractual  obligation  can  be  accomplished,  exactly  what  is  being 
simulated,  what  variables  are  being  simulated,  to  vdiat  level  of 
accuracy  or  within  what  tolerance  band  the  simulation  is  accept- 
able must  be  stated  in  the  contractual  documentation.  An  over- 
view of  the  specifications  (MIL-T-23991 , MIL-T-82335,  MIL-T-9212, 
etc.)  used  in  simulator  procurement  by  the  Military  revealed  that 
many  of  the  variables  felt  required  to  be  specified  by  this 
research  were  not  toleranced  in  any  fashion.  Others  were  toler- 
anced  but  in  an  avdcward  fashion.  Hence,  a set  of  recommended 
FQ&P  tolerances  are  compared  in  Table  13  to  those  published 
in  the  various  simulation  specifications  and  testing  documents 
in  recent  use  by  the  Armed  Services.  The  tolerances  which  are 
recommended  are  based  on  an  engineering  evaluation  of  aerodynamic 
coefficient  data  scatter,  accuracy  of  test  methods,  and  simula- 
tion and  modeling  accuracies  available  today. 

Primarily  three  puLiications  contained  the  tolerancing  infor- 
mation available  on  cockpit  motion  simulation.  MIL-T-82335  and 
MIL-T-9212,  the  Navy  and  Air  Force  General  Specification  for 

35 

Flight  Simulators  and  MIL-STD  1558  , a standard  dealing  with 

the  requirements  of  six-degree-of -freedom  cockpit  motion  systems. 
Table  14  contains  the  published  CM  tolerances  and  the  recommended 
tolerances  to  be  used  vdien  published  tolerances  are  not  found  in 
the  detail  specifications  used  in  the  simulator  procurement. 

The  testing  of  cockpit  motion  systems  is  complicated  by  the 
fact  that  there  is  no  universally  recognized  CM  drive  philosophy. 
This  means  that  the  motion  platforms  are  corraTianded  to  do  differ- 
ent things  depending  on  the  particular  drive  philosophy  chosen. 

As  a result,  the  testing  philosophy  recommended  is  one  that  tests 
the  hardware,  as  a servo  system,  using  standard  static  and 
dynamic  tests.  The  cueing  provided  by  the  motion  simulation  is 
evaluated  in  terms  of:  verifying  the  washout  rates;  verifying 

the  synci.ronization  of  tae  various  systems  being  commonly  driven, 
e.g.,  visual  display,  cockpit  indicators,  g-seat,  g-suit,  etc.; 


35 . MIL-STD-155S , Military  Standard  - "Six  Degree-of -Freedom 
Motion  System  Requirements  for  Aircrewmembers  Training  Simula- 
tors" 22  February  1974. 
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verifying  how  well  the  simulated  cockpit  motion  acceleration 
tracks  the  "ideal"  acceleration  provided  by  the  equations  of 
motion  and  finally  verifying  the  interaction  of  the  cockpit 
motion  hardware  and  the  remaining  simulation  capabilities  such 
as  freeze,  reset,  etc.  Tolerances  are  suggested  for  the  hardware 
attributes,  washout  rates,  cueing  orientation  and  synchroni- 
zation. While  comparisons  can  be  made  between  motion  cueing 
provided  and  the  theoretically  "ideal"  motion,  no  tolerances  can 
be  recommended  for  the  actually  delivered  cueing  since  it  is 
restricted  to  hardware  and  software  drive  philosophy  capabili- 
ties. Tolerances  can  be  and  are  recommended  for  the  timing  of 
the  cueing  and  the  rates  of  washout.  Never -the -less  the  compar- 
isons between  delivered  cockpit  motion  accelerations  and  the 
"ideal"  motions  can  and  should  be  made  a part  of  the  acceptance 
testing  procedures. 

Visual  display  system  testing  is  complicated  because  it  is  a 
new  area  of  simulation  and  in  general  is  loosely  specified  in 
the  procurement  documentation.  Very  little  tolerance  information 
is  available  in  the  general  military  standards.  Table  15  con- 
tains the  published  tolerances  of  MIL-T-9212  and  the  recommended 
tolerances  for  testing  total  end-to-end  system  performance  as 
well  as  sub-system  performance. 

Data  Problems 

No  testing  fhilosophy  can  be  of  value  unless  there  exists  a 
v/ell-defined,  readily  obtained  reference  criterion.  In  the  three 
categories  of  testing  considered  by  this  study,  there  exist 
several  areas  in  vdiich  reference  data  are  not  normally  available. 
The  tests,  conditions,  configurations  and  data  required  for  air- 
craft testing  are  presented  in  MIL-D-8708^^  and  in  the  detail 
specifications  used  in  the  procurement  of  aircraft.  As  thorough 
as  this  document  is  for  aircraft  testing,  still  more  data  is 
required  for  simulator  testing.  Areas  of  particular  importance 
include:  longitudinal,  lateral  and  directional  responses  due  to 

small  control  inputs  (+  1/2  inch) ; power  plant  responses  due  to 
small  (+  1/2  inch)  excursions  of  the  power  level  angle  (for 
approacH"  testing  about  the  "on  speed"  setting)  and  ground  hand- 
ling data.  It  is  important  to  note  the  differences  in  intent 
between  the  two  types  of  testing.  One,  normal  aircraft  testing, 
is  intended  to  determine  the  safety  of  and  suitability  of  the 
aircraft  to  perform  its  intended  role  in  the  Fleet.  The  other, 
simulator  testing,  is  intended  to  ascertain  how  much  like  the 
operational  aircraft  the  simulator  performs. 
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TS"I  Anon : MIL-D-S708  , Military  Specification;  Demonstration 

Requirements  for  Airplanes. 
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f Table  13  denotes  the  data  not  normally  available  in  FQ&P 

i and  engine  performance  testing.  These  data  can  be  obtained  but 

J are  not  currently  required  in  a flight  testing  program.  Another 

1 problem  is  that  the  actual  aircraft  FQ&P  data  is  not  always 

J available  in  the  normally  encountered  operational  performance 

: envelope.  Rather,  it  is  usually  published  for  the  outer  edges 

! of  the  performance  envelope  such  as  limiting  center  of  gravity, 

i overloaded  gross  weight  or  using  trial  control  systems  and  the 

• like.  There  is  no  reason  it  could  not  be  available  since  the 

I normal  operational  envelope  is  first  established  and  then  extend- 

[ ed  to  the  limiting  envelope  via  the  aircraft  testing  process. 

Recognize  that  two  distinct  kinds  of  aircraft  data  are  required 
i to  obtain  and  validate  the  simulation  of  an  operational  aircraft. 

: The  first  type  is  the  coefficient  data  used  to  form  the  forcing 

functions  of  the  differential  equations  of  motion.  This  data  is 
. usually  known  as  stability  derivations,  aerodynamic  derivatives 

I or  aerodynamic  coefficients.  These  data  are  required  to  build 

f the  simulation  of  a specific  aircraft  and  in  fact  are  the  para- 

' \ meters  that  distinguish  one  aircraft's  FQ&P  from  another.  The 

[ ' data  are  usually  obtained  from  wind  tunnel  experimental  work  with 

’ some  occasional  flight  data  reduction  data.  There  exist  several 

\ new,  still  experimental,  computer  algorithms  for  extracting  the 

aerodynamic  derivatives  from  actual  recorded  aircraft  FQ&P 

37 

data.  The  National  Aeronautics  and  Space  Administration 
(NASA) , NAVAIRTESTCEN  and  the  Naval  Air  Development  Center  all 
\ are  active  in  this  attempt  at  extracting  aerodynamic  derivative 

data  from  FQ&P  test  data.  The  FQ&P  test  data  (or  flight  test 
data)  referred  to  is  the  second  general  type  of  data  required  and 
[ 1 is  needed  to  actually  compare  the  resultant  simulation  to  the 

• aircraft  which  is  represented. 

► In  cockpit  motion  system  and  visual  display  system  testing 

the  criteria  of  merit  must  generally  be  established  in  the  pro- 
curement specifications.  That  is,  in  order  to  determine  accept- 
ability of  a CM  system,  its  performance  measures  must  be  stated 
and  then  tested  against  using  some  appropriate  tolerancing  infor- 
mation. The  specified  performance  measures  would  ideally  be 
based  on  engineering/economic/human  factors/training  analysis 
type  inputs  citing  variable  requirements  such  as,  for  example, 
excursion  limits,  as  a function  of  training  requirements  temper- 
ed with  engineering  capability  and  economic  realities.  In  any 
case,  the  current  state-of-the-art  allows  only  the  "mechanical" 
performance  characteristics  of  the  CM  on  VD  system  to  be  speci- 
fied and  tested  against.  We  do  not  know  v^ich  CM  drive  philoso- 
phy is  "best"  nor  do  we  loiow  vhat  is  required  from  the  CM  system 
with  respect  to  jerk,  acceleration,  velocity  cueing  philosophy 
[ or  washout  algorithm  choice  with  respect  to  training  effective- 
ly ness. 

T7~.  Grove,  Randall  D.  , and  Mayhew,  Stanley  C.  , "A  Real-time 
Digital  Program  for  Estimating  Aircraft  Stability  and  Control 
Parameters  from  Flight  Test  Data  by  Using  the  Maximum  Likelihood 
Method,"  NASA  TMX-2788,  December  1973. 
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SECTION  VI 
CONCLUSIONS 

Several  conclusions  were  made  during  this  task.  They  are: 

a.  A methodology  exists  for  assessing  the  fidelity  of  the 
Flying  Qualities  and  Performance  simulation.  It  is  based  upon 
measures  that  are  discernible  to  the  pilot  at  the  conscious  or 
subconscious  levels  of  awareness  and  compares  simulator  perform- 
ance to  aircraft  performance. 

b.  A methodology  exists  for  testing  cockpit  notion  systems 
with  respect  to  mechanical  performance  characteristics. 

c.  Cockpit  motion  cueing  delivered  by  the  motion  platform  is 
a function  of  the  choice  of  drive  philosophy  algorithm  chosen  and 
hardware  capability.  Hence,  unless  a particular  drive  algorithm, 

\ gains,  scaling,  etc.,  can  be  stated  a priori , only  subjective 

appraisals  can  be  used  to  determine  acceptability  of  the  deliver- 
ed cueing. 

d.  Visual  display  technology  is  relatively  new;  however, 

r engineering  testing  can  be  performed  at  the  system  and  sub-system 

level.  Several  industrial  and  commercial  practices  are  available 
for  determining  television  sub-system  performance. 

e.  It  is  possible  to  "certify"  the  Flying  Qualities  and 
performance  simulation  to  be  as  per  the  equivalent  aircraft 

' criteria  within  tolerances. 

’ f.  The  ultimate  goal  for  all  simulators  is  to  train;  how- 

ever, no  relationships  are  published  which  relate  training 
effectiveness  and: 

' (1)  Flying  Quality  and  Performance  simulation  fidelity. 

(2)  Cockpit  motion  performance  measures  such  as: 

(a)  Linear  and  Angular  excursions 

(b)  Linear  and  Angular  velocities 

(c)  Linear  and  Angular  accelerations 

(d)  Drive  philosophies  (jerk,  acceleration, 
velocity  or  positional  matching) 

(e)  Washout  algorithms 
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(3)  Visual  display  system  performance  measures  (resolu- 
tion, contrast,  information  content,  etc.) 

Hence,  the  acceptance  testing  cannot  be  based  upon  training 
effectiveness  requirements. 

g.  No  simulation  tolerances  exist  with  respect  to  training 
effectiveness.  The  tolerances  recommended  in  this  study  are 
based  upon  judgments  of  engineering  feasibility  tempered  with 
economic  viability. 

h.  There  are  currently  areas  of  FQ&P  data  which  are 
obtainable  but  not  normally  collected  in  aircraft  testing.  These 
areas  are  required  and  must  be  acquired  to  adequately  evaluate 
the  engineering  performance  of  simulations. 

i.  In  determining  acceptability  of  engineering  performance 
of  cockpit  motion  and  visual  display  systems,  desired  values  of 

\ the  various  performance  measures  along  with  tolerances  must  be 

' stated  in  the  relevant  procurement  documents. 

j.  There  is  a strong  tendency  encountered  in  the  testing  of 
complex  systems  to  measure  a variable  or  parameter  simply  because 
it  can  be  measured.  A concerted  effort  must  be  made  to  not 
measure  some  of  the  classical  variables  of  flight  simulation 
(e.g.,  lift,  drag,  etc.)  in  favor  of  more  inclusive  measures 
(acceleration,  deceleration,  etc.).  Acceptance  testing  is  not  to 
be  confused  with  "trouble-shooting"  testing  in  which  the  inter- 
mediate variables  are  of  paramount  importance.  In  cockpit  motion 

‘ and  visual  display  system  testing  sub-system  testing  must  be  per- 

formed because  few  over-all  performance  standards  can  be  estab- 
lished. 

k.  The  "flight"  test  data  requirements  for  simulator  testing 
are  in  many  ways  more  restrictive  than  for  actual  aircraft  test- 

■ ing.  For  example,  areas  such  as  wheel  brake  effectiveness  in 

aircraft  is  somewhat  subjectively  evaluated  as  "stops  safely  in 
required  number  of  feet."  The  simulator  must  match  the  brake 
deflections  and  forces  as  well  as  the  rate  of  turn  per  differ- 
* ential  brake  application  (within  established  tolerances) . Visual 

display  system  performance  capabilities  increase  the  data  re- 
quirements and  tolerances. 

l.  MIL-D-8708  would  represent  a suitable  forum  for  stating 
the  engineering  test  data  requirements  for  use  in  simulator 
testing  as  well  as  for  its  original  purpose. 
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a.  The  relationships  between  training  effectiveness  and; 

(1)  Flying  Quality  and  Performance  simulation  fidelity 

(2)  Cockpit  motion  performance  measures  - linear  and 
angular  excursion,  velocity  and  acceleration;  drive  philosophy, 
etc . 


(3)  Visual  display  system  performance  measures 

be  investigated  in  order  to  establish  testing  requirements,  simu- 
lation requirements  and  tolerances  in  terms  of  training  needs. 

b.  The  Flying  Qualities  and  Performance  measures  and  simu- 
lation tolerances  be  established  for  rotary  wing  aircraft. 

c.  Performance  requirements  and  tolerances  be  specified  in 
the  procurement  docvimentation  when  simulation  systems  are  to  be 
purchased. 

d.  The  flight  test  data  requirements  be  established  in  some 
"normalized"  fashion  such  that  the  original  flight  test  work  and 
the  simulator  "flight"  test  work  could  proceed  simultaneously. 
This  normalization  would  be  based  upon  defined  but  indeterminant 
(a  function  of  specific  aircraft)  values  such  as,  for  example, 
maximum  velocity  minus  minimum,  velocity  divided  by  some  value  and 
added  to  the  minimum  velocity.  MIL-D-8708  cites  somewhat  normal- 
ized testing  conditions  such  as  "at  least  stall  speed  (landing 
configuration)  plus  20"  and  would  serve  as  a useful  guide. 

e.  MIL-D-8708  should  be  updated  to  reflect  the  data  require- 

ments for  simulator  testing  as  well  as  aircraft  testing.  Areas 
of  particular  importance  are:  airframe  responses  to  small 

(+  1/2  inch)  excursions  of  the  power  lever  and  control  device 
about  the  optimum  approach  speed  power  setting  and  ground  hand- 
ling characteristics. 
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FIGURE  1.  Visual  System  Test  Configurations, 
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FIGURE  1 .(Continued)  Visual  Systern  Test  Conf igurations . 
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FIGURE  1,  (Continued)  Visual  System  Test  Configurations, 
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FIGURE  1.  (Continued)  Visual  System  Test  Configurations. 
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PHOTOMETER 


TEST  SETUP  N 


PHOTOMETER 


GRAYSCALE  TEST 
CHART 


TEST  SETUP  0 


FIGURE  1.  (Continued)  Visual  System  Test  Configurations. 
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TEST  CHART 


TEST  SETUP  P 


TEST  SETUP  R 


FIGURE  1.  (Continued)  Visual  System  Test  Configurations. 
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COLOR  BAR 
TEST  CHART 


TEST  SETUP  S 


FIGURE  1.  (Continued)  Visual  System  Test  Configurations. 
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TABLE  1.  MIL-T-23991  TRAINING  DEVICE  EXAMINATIONS 


Materials 

Parts  { standard/nonstandard) 

Design 

Construction  processes 

Assembly  and  fit 

Wire  markings 

Dimensions  and  tolerances 

Size  and  weight 

Color 

Finish  (corrosion  protection  and  treatment) 

Nameplates  and  product  markings 

Safety 

Workmanship 
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TABLE  2.  MIL-T-23991  TRAINING  DEVICE  TESTS 

Functional 
Trainer  operation 
Structural 
Electrical 

Grounding  and  grounding  systems 
Human  Factors  Engineering  compliance 
Reliability 
Environmental 

Electromagnetic  interference  suppression 
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TABLE  3.  MIL-T-9212 (USAF) -TRAINING  DEVICE  TESTS 

Aerodynamic  cross-coupling 
Aerodynamic  drag 
Aircraft  systems 
Cargo  extraction 

Contractor-prepared  test  outline 
Control  force  vs  control  deflection 
Actuator  response 
Control  friction  and  inertia 
Trim  response 
Dynamic  stability: 

Low  frequency  gain 
Spiral  stability 
Transient  response 
Electrical  power  input 
Electromagnetic  interference 
Engine : 

Idle  governing  speed 
Oil  pressure 
Oil  temperature 
Rates 
Speed 
Thrust 
Windmilling 
Examination  of  product 
Exhaust  gas  temperature 
Forward  speed: 

Acceleration  and  deceleration 
Fuel  flow  rate 
Fuel  depletion 
Fuel  pressure 
Ground  steering 
Human  engineering/performance 
Inertia  cross  coupling 
Mach  no.  vs  true  airspeed 
Maintainability  demonstration: 

Maintenance  manuals  and  observations 
Maintenance  task  time 
Maintainability  test  methods 
Materials  and  processes 
Max  speed  indicator 
Motion  systems  tests: 

Displacement  of  flight  compartment  motion 
Limits  of  motion 
Platform  response 
Navigation 
Normal  operation 
Pitch  control  on  ground 
Power  calibration 
Power  plant  controls  schedule 
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TABLE  3.  MIL-T-9212 (USAF) -TRAINING  DEVICE  TESTS  (Continued) 

Pressure  ratio 

Reliability  demonstration  and  test: 

Adjustments 
Failure  recording 

Preventive  maintenance  during  test 
Reliability  sampling  and  longevity  tests 
Test  plan 

Repeater  instruments 
Servos 

Stalls  and  buffet 
Stopping  time 

Surface  deflection  vs  constant  pitch  rate: 

Pitch  acceleration 

Surface  deflection  vs  constant  roll  rate: 

Roll  acceleration 

Surface  deflection  vs  control  deflection 
Surface  reflection  vs  yaw  rate; 

Yaw  acceleration 
Takeoff 

True  airspeed  vs  indicated  airspeed 
Turbine  air  temperature 
Ventilation 
Vertical  Speed: 

Vertical  acceleration  and  deceleration 
Visual  simulation  system; 

Geometric  distortion 
Image  quality 
Display  contrast 
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TABLE  4.  SDC  911-600  TRAINING  DEVICE  EXAMINATIONS 

a.  Control  System  Function 

b.  Performance 

(1)  Stall  and  Approach  Speeds 

(2)  Takeoff 

(3)  Climb 

(4)  Level  Flight 

(5)  Performance  at  Altitude 

(6)  Engine  Characteristics 

(7)  Fuel  Consumption 

(8)  Engine-out  Performance 

(9)  Acceleration  Performance 

(10)  Deceleration  Perform.ance 

(11)  Descent  Performance 

c.  Longitudinal  Stability  and  Control 

(1)  Dynamic  Longitudinal  Stability 

(a)  Short  Period  Oscillation 

(b)  Phugoid  Oscillation 

(2)  Static  Longitudinal  Stability 

(a)  Elevator  Control  Effectiveness 

(b)  Elevator  Control  Forces 

(3)  High  Speed  Requirements 

(a)  High  Speed  Warning 

(b)  Control  Forces  in  a Dive 

(4)  Longitudinal  Trim  Changes 

(5)  Longitudinal  Trimming  Devices 

d.  Directional  Stability  and  Control 

(1)  Dynamic  Directional  Stability 

(a)  Lateral-Directional  Oscillation 

(b)  Short  Period  Rudder  Oscillation 

(c)  Spiral  Stability 

(2)  Static  Directional  Stability 

(a)  Steady  Yaw 

(b)  Rudder-fixed  Terms 

(c)  Rudder-free  Asymmetric  Thrust 

(3)  Rudder  Control  Effectiveness 

(a)  Taxiing 

(b)  Asymmetric  Thrust 

(c)  Adverse  Yaw 

(4)  High  Speed  Requirements 

(5)  Directional  Trimming  Devices 

e.  Lateral  Stability  and  Control 
(1)  Dynamic  Lateral  Stability 

(a)  Lateral-Directional  Oscillation 

(b)  Dihedral  Effect 

(c)  Criterion  Control  Effectiveness 
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TABLE  4.  SDC  911-600  TRAINING  DEVICE  EXAMINATIONS  (Continued) 

(2)  High  Speed  Requirements 

(3)  Lateral  Trimming  Device 

(4)  Stalling  Characteristics 

g.  Power  Operated  and  Power  Boost  Control  System 

(1)  Control  Force  with  Power  Control  System 

(2)  Emergency  Requirements,  Power  Control  System 
Inoperative 


(a) 

Elevator 

(b) 

Rudder 

(c) 

Aileron 

(3)  Rolling  Velocity 

(4)  Multiple  Power  Control  Systems  | 

I 

h.  Design  of  Control  Loading  System  ! 

i.  Aircraft  Systems 

(1)  Electrical 

(2)  Hydraulic  and/or  Pneumatic 

(3)  Power  Plant 

(4)  Fuel 

(5)  Oil 

( 6 ) Oxygen 

(7)  Pressurization 

(8)  Heating  and  Ventilation  ^ 

(9)  Electronic  Equipment  , 

(10)  Armament 

(11)  Radio  Aids  Installation  i 

« 

j.  Aircraft  Instrument  Calibration  « 

(1)  Altimeter  ' 

(2)  Compass  * 

(3)  Airspeed  ^ 

(4)  Rate  of  Climb 

(5)  Gyro  Horizon 
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TABLE  5.  SIMULATION  SYSTEM  TESTING  AREAS  (Continued) 
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TABLE  6.  SIMULATION  FIDELITY  PROBLEM  AREAS 

a.  Incorrect  Mathematical  Model 

b.  Incorrect  Simplifying  Assumptions 

c.  Valid  model  but  incorrect  implementation 
. unstable  integration 

. incorrect  equation  sequencing 
. incorrect  data  entry  into  model 
. programming  mistakes 

d.  Hardware  Problems 

. Hydraulic  servos 
. Electrical  servos 
. Conversions 
. Computer 

e.  Physical  impossibility  of  simulation 

(Motion) 


4 
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TABLE  7.  PROJECT  2235  (USAF)  TECHNICAL  TESTING  PROGRAM 
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Target  Image  Location  PHO  Trigger 

Dynamic  Lag  TS-Q 
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TABLE  8.  RECOMMENDED  VISUAI,  DISPLAY  TESTING 
Television  System  Tests 

. Horizontal  and  vertical  resolution  of  pickup  and  display 
components 
. Gray  scale 
. Video  handwidths 
. Video  signal  levels 
. Noise  levels 
. A picture  correction 
. Gamma  Correction 
. Linear  phase  characteristics 
. Impedance  matching 
. Hum 

. Target  projector  blanking 

Display  Screen  Tests 

. Screen  radius 
. Uniformity  of  curvature 
. Seam  visibility 
. Screen  gain 

Optical  System  Tests 

. Focal  length,  back  and  front  focal  distances  as  a function 

of  the  zoom  position  i 

. Size  and  position  of  the  entrance  pupil  for  camera  lenses  i 

and  the  exit  pupil  for  projection  lenses  as  a function  of  | 

the  zoom  position  or  as  a function  of  field  angle  for 
wide  angle  lenses 

. Relative  illumination  as  a function  of  field  angle 
. Resolving  power  as  a function  of  field  angle  and  zoom 
position  and  spectral  distribution  of  illumination  equal 
within  10%  to  that  of  the  normal  system  operation 
. Distortion 

. Image  size  and  field  of  view 

. For  the  target  camera  lens,  depth  of  field  as  a function 
of  range  and  the  corresponding  zoom  position 

Model  Tests  - per  specification 

Servo,  gantry  and  qimbal  system  tests 

. Motion  excursion  limits 
. Velocity  limits 
. Acceleration  limits 
. Positional  accuracy 
. Threshold  sensitivity 
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TABLE  8.  RECOMMENDED  VISUAL  DISPLAY  TESTING  (Continued) 

Servo,  gantry  and  gimbal  system  tests 

. Repeatability 
. Smoothness  of  operation 
. Jitter 
. Vibration 
. Frequency  response 
. Deceleration  limits 

FLOLS  tests  per  the  specification 

Computer  Interface  tests  per  the  specification 

Controls  tests  per  the  specification 

^ System  tests 

. Horizontal  and  vertical  resolution  as  a function  of 
field  angle  consistent  with  the  combined  requirements 
of  image  luminance,  and  shades  of  gray 
. Target  and  background  gray  scale 

' . Separate  target  and  background  image  luminance  as  a 

function  of  field  angle 

. Separate  target  and  background  image  distortion 
. Target  and  background  image  distortion 
. Target  image  size  as  a function  of  range 
I . FLOLS  image  size  and  position  relative  tc  the  target 

image  as  a function  of  range  and  viewing  direction 
. Target  image  and  FLOLS  image  tracking  accuracy 
. Field  of  view 
. Image  jitter 
. Target  image  insetting 

' System  integration  tests 

Electrical  tests 

Grounding  tests 

Electromagnetic  interference  suppressi:  ..  tests 
Structural  tests 


Human  factors  tests 
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TABLE  9.  RECOMMENDED  AREAS  OF  FI-YING  QUALITY  AND 
PERFORMANCE  TESTING 

. Mechanical  characteristics  of  the  control  systems 
. Steady  state  trim  points 
. Longitudinal  trim  changes 
. Static  longitudinal  stability 
. Maneuvering  stability 
. Dynamic  longitudinal  stability 
. Static  lateral-directional  stability 
, Dynamic  lateral-directional  stability 
. Engine  out  flying  qualities 
. Ground  handling  characteristics 
. Takeoff  characteristics 
. Airflight  characteristics 
. Landing  characteristics 
. Engine-out  performance 
. Engine  statics 
. Engine  dynamics 
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TABLE  10.  RECOMMENDED  AREAS  OF  COCKPIT  MOTION  TESTING 


System  Attributes 


Simulation  Attributes 


Static  accuracy 

Repeatabil ity 

Linearity 

Excursion  Limits 

Velocity  Limits 

Acceleration  Limits 

Crosstalk 

Long  term  drift 

Smoothness 

Stability 

Cue  Synchronization 


Buffet 

Landing,  Takeoff 
Propulsion  Effects 
Rough  Air 
Trim  changes 
Stores  release 
Tactical  maneuvering 
Stall 
Spin 


I 

'r 


Miscellaneous  tests 


Dynamic  Performance 


Frequency  response 
Transient  response 


Freeze 

Crash 

Reset 

Isolation 

Manual  Operation 
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TABLE  11.  RECOMMENDED  AREAS  OF  VISUAL  DISPLAY  SYSTEM 
TESTING 

System  Tests  - Static 

. Static  Accuracy 
. Image  Size  and  Perspective 

System  Tests  - Dynamic 

. Transient  Response 
. Steady  State  Time  Lags 
. Frequency  Response 

System  Tests  - Simulation  Attributes 

System  Tests  - Interface  Performance 

System  Tests  - Displays 

. Luminance 
. Resolution 
. Contrast 
. Depth  of  Field 
. Field  of  View 

. Geometric  Distortion  and  Linearity 
. Display  Refresh  Rate 
. Raster  Burn 

. Multiple  Channel  Video  Tracking 

. Multiple  Channel  Luminance  Tracking 

Infinity  Display  Optics  Tests 

. Viewing  Volume 
. Collimation 
. Mirror  Tests 

Display  Tests  - Color  Performance 

. Convergence 
. Color  capability 

. Color  tracking 

Display  Tests  - Zoom  optics 

. Magnification 
. Optical  Axis  Shift 

Model  Board  Tests 

. Texture 
. Color 

. Illumination 
. Dimensions 
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TABLE  11.  RECOMMENDED  AREAS  OF  VISUAL  DISPLAY  SYSTEM 
TESTING  (Continued) 

Servo  Tests 

. Excursion  Limits 
. Velocity  Limits 
. Acceleration  Limits 
. Static  Accuracy 
. Repeatability 
. Dynamic  Accuracy 
. Transient  Response 
. Frequency  Response 
. Reset  Speed 

Television  System  Tests 

. Bandwidth 
. Gamma 

. Signal  to  Noise 
. Resolution 

Television  Camera  Tests 

. Geometric  Distortion 
. Resolution 
. Gray  Scale 
. Luminance 

Optical  System  Tests 

. Image  size 
, Entrance  Pupil 
. Depth  of  Field 
. Focal  Length 
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TABLE  12.  OPTIMUM  SEQUENCING  OF  TESTS 
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NOTES 


Note  (U 


Condi tions 

F 

BO 

''S/N^ 

Tolerance 

(a)  Fighter  aircraft 
Attack  aircraft 

C.25 

|(F^/N^)oXl.0g 

j > 7 Ib/g 

3 Ib/g 

C.ZS 

[{%/N,),xl.0g' 

] 4 lb/gsFj/g^7  Ib/g 

4 lb/g*Fj/g57  Ib/g 

C.2S 

[Fs/N^)oXl.0g“ 

1 ^4  Ib/g 

15S 

(b)  Patrol  and 

>.25 

[[F^/N,),xl.0g] 
r "1 

all 

(-0.5(F^/N^)  + 15)* 

logistics  aircraft 

4.05  1 

[(F^/NJo^l.Og] 

> 55  Ib/g 

10  Ib/g 

<•05 

|(F3/N^)„xl.0g] 

40  lb/g<F^/N^55  Ib/g 

40  lb/g<Fj/N<55  Ib/g 

<•05  [ 

Tf^/N,),x1.5J 

440  Ib/g 

20% 

>.05  1 

^F^/N^)oXl.0g] 

all 

(-0.145(Fj/N^)  20% 

Note  (2) 

Variable 

'"bo 

Condition 

Tolerance 

Short  period 

damolnq  ratio 

. 1 
.05 

.025  Out  same  sign  as  aircraft 
.1 

.05  same  sign  as  aircraft 
. 1 Hz 

.5  not  Imaginary  unless  aircraft 
.1  Hz 

.05  Hz  not  Imaginary  unless  air- 
craft Is 

Tolerance 

damolng 

Fighter,  attack 
dairplnc, 

“atrol , logistics 

freouency 
Fighter,  attack 

freouency 
Patrol , logistics 

Note  (3) 

Condition 

2 .55 

.l<xi.55 

0 <X5 .1 

> .4 
S .4 

undamped  natural  freouency  (Hz) 
^ .7 
< .7 

> .4 
4 .4 

F /N 
s'  z 

(a)  Fighter  and  attack 

4-25  Fj 

> 4 Ib/g 

10% 

<.25  F^ 

< 4 Ib/g 

15% 

>.25  Fj 

all 

-.5  IF^/N^)^  r 15% 

(b)  Patrol  and 

Logistics 

< .05  F 

s 

> 55  Ib/g 

10  'D/g 

< .05  Fj 

40‘ F^  N < 55  ib/g 

40  F^,'N^  55  Ib'g 

< -05  Fj 

< 40  Ib/g 

20% 

> .05  Fj 

all 

(-.145  Fj  ♦ 20%) 
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TABLE  14.  COMPARISON  OF  AND  RECOMMENDATION  OF  SIMULATION  OF  COCKPIT 
MOTION  TOLERANCES  (Continued) 


lateral,  and  direction 
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TABLE  15.  COMPARISON  OF  AND  RECOMMENDATION  FOR  VISUAL 
DISPLAY  SIMULATION  TOLERANCES 

TESTS  MIL-T-9212  TOLERANCE  RECOMMENDED  TOLERANCE 


Static 


1.  Static  accuracy 

a.  Roll  excursion 

b.  Pitch  excursion 

c.  Yaw  excursion 

d.  X excursion 

e.  Y excursion 

f.  Z excursion 


2.  Image  size  and 
perspective 


10%  of  computed  value 
10%  of  computed  value 
10%  of  computed  value 
25  ft  of  computed 
value 

25  ft  of  computed 
value 

10  ft  below  100  ft, 
10%  of  computed 
above  100  ft 
Shall  be  correct, 
no  tolerance  given 


0.5® 

0.5® 

0.5® 

0.5%  of  command 
0.5%  of  command 
0.5%  of  command 


5%  of  theoretical 


Dynamic  Performance 


1.  Transient 
response 


2 . Steady  state 
time  lags 


3.  Frequency 


No  tolerance  given 


No  tolerance  given 


No  tolerance  given 


No  overshoot  allowed 
greater  than  2%, 
i.e.,  damping  great- 
er than  or  equal  to 
.8.  The  10%  settling 
time  shall  be  as 
specified  + 20  msec. 
(If  no  10%  settling 
time  is  recommended, 
a 100  msec  maximum 
is  suggested. ) 

As  specified  + 10%. 

If  not  spec if  Ted, 
recommend  lag  to  be 
less  than  60  msec. 

As  specified  + 10% 
of  cimplitude  "(not 
measured  in  Db)  and 
phase 


Simulation  Attributes 


1 . Scene  content 

2 . Scene  movement 


No  tolerance  given 
No  tolerance  given 


At  least  the  speci- 
fied number  of  edges 
or  surfaces 
No  erratic  movement 
or  jitter  shall  occur 
in  flight. 
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TABLE  15.  COMPARISON  OF  AND  RECOMMENDATION  FOR  VISUAL 
DISPLAY  SIMULATION  TOLERANCES  (Continued) 

TESTS  MIL-T-9212  TOLERANCE  RECOMMENDED  TOLERANCE 

3.  Fresnel  Lens 

No 

tolerance 

given 

1/10  ball,  subjective 

Optical  Landing 
System  (as 
applicable) 

4 . Visual  Approach 

No 

tolerance 

given 

appraisal  of  FLOLS 
size  as  a function  of 
range . 

0.1% 

Slope  Indicator  - 
VASI  - (as  appli- 
cable) 

5.  Strobe  light 

No 

tolerance 

given 

DNA 

ope ration 
6.  Atmospheric 

No 

tolerance 

given 

DNA 

Effects  - clouds, 
haze,  fog,  etc. 

7.  Directional 

No 

tolerance 

given 

DNA 

■ 

lights  (as 
applicable) 

8.  Runway  markings 

No 

tolerance 

given 

DNA 

(as  applicable) 

9.  Approach  lights 

No 

tolerance 

given 

DNA 

- 

(as  applicable) 

10.  Horizon  intensity  No  tolerance  given 

DNA 

(as  applicable) 
11.  Beacon  light 

No 

tolerance 

given 

DNA 

12.  Carrier  edge 

No 

tolerance 

given 

As  specified,  DNA 

• 1 

lights  (as  appli- 
cable) 

13.  Carrier  runway 

No 

tolerance 

given 

As  specified,  DNA 

. - • 

center  lights  (as 
applicable) 

14.  Carrier  runway 

No 

tolerance 

given 

As  specified,  DNA 

' * 

\ 

i-- 

edge  lights  (as 
applicable) 

15.  Carrier  runway 

No 

tolerance 

given 

As  specified,  DNA 

athwartships  lights 
(as  applicable) 

*16.  Carrier  axial 

No 

tolerance 

given 

As  specified,  DNA 

deck  bow,  ath wart- 
ship  lights  (as 
applicable) 

17.  Carrier  vertical 

No 

tolerance 

given 

As  specified,  DNA 

dropline  lights 
(as  applicable) 

18.  Eyeheight  above 

No 

tolerance 

given 

DNA 

runway 

19.  Mission  playback 

No 

tolerance 

given 

Subjective  - DNA 

1 ■ 

(as  applicable) 
20.  Demonstration 

No 

tolerance 

given 

DNA 

maneuvers  (as 
applicable) 
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TABLE  15.  COMPARISON  OF  AND  RECOMMENDATION  FOR  VISUAL 
DISPLAY  SIMULATION  TOLERANCES  (Continued) 


TESTS 


MIL-T-9212  TOLERANCE  RECOMMENDED  TOLERANCE 


a.  Basic  powered 
flight  maneuvers 

b.  Ground  taxi 

c.  Takeoff  (normal, 
field) 

d.  Takeoff 
(catapult) 

e . Approach 

f.  Waveoff 

g.  Landing  (Normal) 

h.  Landing 
(arrested) 

i.  Inflight  refueling 

j.  Weapons  delivery 

k.  Air  combat 
maneuvering 

Interface  Performance 


1.  Freeze 

2 . Crash 

3.  Reset 

4.  Isolation 

5.  Systems  synchron- 
ization (visual, 
motion  and  instru- 
ment simulation) 

Di splays 

1.  Luminance,  and 
uniformity  of 
luminance  for  back- 
ground and  targets 

2.  Resolution  (on 
and  off  axis) 
horizontal  and 
vertical . 

3.  Contrast  or 
contrast  ratio 

4 . Depth  of  field 
(not  applicable  to 
CGI  Systems) 

5 . Field  of  view 


No  tolerance  given 
No  tolerance  given 
No  tolerance  given 
No  tolerance  given 
No  tolerance  given 


Greater  than  mini- 
mum specified,  shall 
not  vary  more  than 
30%  throughout  the 
display 

Greater  than  speci- 
fied minimum 


Greater  than 
minimum 

50  to  30,000  ft 
No  tolerance  given 

In  detail  specifica- 
tion 


Subjective  - DNA 
Subjective  - DNA 
Subjective  - DNA 
Subjective  - DNA 
Response  initiation 
shall  occur  within 
20  msec  of  each 
other . 


Greater  than  minimum 
specified  value  with 
corner  luminance  no 
less  than  70%  of 
center  luminance. 

On  axis,  specifica- 
tion minimum;  off 
axis,  no  less  than 
80%  of  the  on  axis 
minimum. 

Greater  than  minimum 
specification  value. 
Greater  than  the 
specification 
minimum. 

1° 
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TABLE  15.  COMPARISON  OF  AND  RECOMMENDATION  FOR  VISUAL 
DISPLAY  SIMULATION  TOLERANCES  (Continued) 


TESTS 


6.  Geometric  dis- 
tortion and  linearity 


7.  Display  refresh 
rate 

8 . Raster  burn 

9.  Multiple  channel 
video  tracking  (as 
applicable) 

10.  Multiple 
channel  luminance 
tracking 

Infinity  Display  Opti 

1.  Viewing  volume 

2.  Collimation 


3.  Mirror  tests  (as 
applicable) 

a.  Radius  (spheri- 
cal mirror) 


b.  Uniformity  of 
curvature  (spher- 
ical mirror) 

c.  Mirror  smooth- 
ness (spherical) 


MIL-T-9212  TOLERANCE 


"Shall  be  correct,  " 
No  tolerance  given 


No 

tolerance 

given 

No 

tolerance 

given 

No 

tolerance 

given 

No 

tolerance 

given 

!S 

No  tolerance  given 

6 arc  minutes  on 
axis  40  arc  minutes 
off  axis 

No  tolerance  given 

No  tolerance  given 
No  tolerance  given 


RECOMMENDED  TOLERANCE 


Grids  within  5°  of 
optical  axis,  6 arc 
min  deviation;  from 
5°  to  100°,  1%  of 
raster  height; 
greater  than  100°, 

1°. 

Greater  than  speci- 
fication minimum 
Not  discernible 
Slope  changes  shall 
not  exceed  the 
greater  of  1°  or  0.5° 
15% 


Equal  or  better 
than  specified 
+ .02  diopters  of 
specified  value 


The  maximum  blur 
circle  dimension 
composing  the  image 
of  the  stop,  on  the 
opposite  side  of  the 
center  of  curvature 
shall  be  within  10% 
of  the  specified 
value 

The  radius  variation 
shall  be  less  than 
0.5% 

Subjective  - An 
observer  located  at 
the  approximate 
center  of  curvature 
shall  not  observe 
the  reflex  image  of 
the  edge  to  have 
any  waviness  (caused 
by  surface  face 
ripples)  or  feathery 
raggedness  (orange 
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TABLE  15.  COMPARISON  OF  AND  RECOMMENDATION  FOR  VISUAL 
DISPLAY  SIMULATION  TOLERANCES  (Continued) 


TESTS 


Color  Performance 
1 . Convergence 


2.  Color  capability 

3.  Color  tracking 
(as  applicable) 

Zoom  Optics 

1.  Magnification 

2.  Optical  Axis 
Shift 


MIL-T-9212  TOLERANCE 


No  tolerance  given 


No  tolerance  given 
No  tolerance  given 

No  tolerance  given 
No  tolerance  given 


RECOMMENDED  TOLEiV^NCE 


peel  effect)  or  any 
other  irregularity 
using  only  the 
unaided  eye. 


In  a circular  area 
of  diameter  .8  times 
picture  height  con- 
vergence error  shall 
be  less  than  0.1%  of 
picture  height.  In 
a circular  area 
whose  diameter  is 
equal  to  the  height, 
the  convergence 
error  shall  be  less 
than  0.2%.  In  the 
remaining  corner 
area,  the  error  shall 
be  less  than  0.5%. 
Better  than  specifi- 
cation value 
DNA 


5% 

Target  shift  shall 
not  exceed  5 arc 
minutes 


General  Parameters 

1 . Texture 

2.  Color 

3.  Illumination 

4.  Dimensions  (over- 
all) 

Servo  Tests 


No  tolerance  given 
No  tolerance  given 
No  tolerance  given 

No  tolerance  given 


DNA 

DNA 

Better  than  speci- 
fied minimum 
0.5  feet 


1.  Excursion  limits 

2.  Velocity  limits 


No  tolerance  given  Equal  to  or  greater 

than  specified 

No  tolerance  given  Equal  to  or  greater 

than  specified 


A 
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TABLE  15.  COMPARISON  OF  AND  RECOMMENDATION  FOR  VISUAL 
DISPLAY  SIMULATION  TOLERANCES  (Continued) 

TESTS  MIL-T-9212  TOLERANCE  RECOMMENDED  TOLERANCE 


3.  Acceleration 
limits 

4.  Static  accuracy 
(positional) 

5.  Repeatability 

6 . Dynamic  accuracy 
(velocity  tracking) 


No  tolerance  given 
No  tolerance  given 
No  tolerance  given 
No  tolerance  given 


7 . Transient  No  tolerance  given 

response 


8 . Frequency  No  tolerance  given 

response 

9.  Reset  speed  No  tolerance  given 


Equal  to  or  greater 
than  specified 
.15%  of  command 

.02%  of  initial 
command 

Response  amplitude 
shall  be  within  10% 
of  command.  Velocity 
fluctuations  shall 
be  less  than  2%  of 
command 

Damping,  .1  of  speci- 
fied value;  natural 
frequency,  .2  Hz  of 
specified.  If  not 
specified,  recommend 
,7+.l  damping,  25+3 
radians  per  second 
frequency 

0 to  1 Hz,  2db,  10“ 

1 Hz  to  2 Hz,  4db, 
20“,  2 Hz  to  5 Hz, 
8db,  40“ 

10%  of  specified. 

If  not  specified,  10 
inches/sec 


Television  System 
1 . Bandwidth 


2 . Gamma 


3.  Signal  to  noise 


No  tolerance  given 


No  tolerance  given 


35db  down 


Specification  value 
+5  MHz.  If  not 
specified,  recommend 
1.5  picture  elements 
(black  and  white) 
per  sec  at  3db  down 
Within  10%  of 
specified  or  unity 
if  not  specified 
Specification  value 
+2db.  If  not 
specified,  recommend 
40  db  down . 
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TABLE  15.  COMPARISON  OF  AND  RECOMMENDATION  FOR  VISUAL 
DISPLAY  SIMULATION  TOLERANCES  (Continued) 


TESTS 

MIL-T-9212  TOLERANCE 

RECOMMENDED  TOLERANCE 

4.  Resolution 

Better  than : 

Greater  than  speci- 

Pilot's eye  pos'n 

fied,  recommend  700 

8 min  of  arc 

TV  lines  minimum  in 

6 min  of  arc 

center,  550  in 

4 min  of  arc 
Modulation  Transfer 

575%^ 

25% 

10% 

corners 

Television  Camera 

1.  Geometric 

Given  as  system 

2%  of  picture  height 

Distortion 

tolerance 

2 . Resolution 

Given  as  system 

Per  Table  I of  EIA 

tolerance 

Standard  RS-343-A, 
Electrical  Perform- 
ance Standards  for 
High  Resolution 
Monochrome  Closed 
Circuit  Television 
Camera 

3 . Gray  Scale 

Given  as  system 

All  ten  steps  of  the 

tolerance 

EIA  resolution  chart 
shall  be  visible 

4 . Luminance 

Detail  specification 
values  +5% 

Optical  System 

1.  Image  size 

No  tolerance  given 

All  tolerances  re- 
quired for  this 
section  are  to  be 
supplied  in  the 
Detail  Specification 

2.  Entrance  Pupil 

No  tolerance  given 

size  and  position 

3.  Depth  of  field 

No  tolerance  given 

4 . Focal  length 

No  tolerance  given 

86 


NAVTRAEQUIPCEN  IH-251 


REFERENCES 


SECTION  I 

1.  Mackie,  Robert  R. ; Kelley.  Gene  R.;  Moe,  Gary  L.  and 

Meckerikoff,  Michael:  "Factors  Leading  to  the  Acceptance  or 

Rejection  of  Training  Devices,"  NAVTRAEQUIPCEN  70-C-0276-0, 
August  1972. 

2.  Ryan,  L.  E.;  Puig,  J.  A.;  Michel i,  G.  S.;  and  Clarke,  J.  C.: 

"An  Evaluation  of  the  Training  Effectiveness  of  Device  2F90, 
TA-4J  Operational  Flight  Trainer:  Part  1:  The  B-Stage," 

NAVTRAEQUIPCEN  Technical  Report  IH-207. 

3.  O'Conner,  F.  E.  CAPT  USN:  Shinn,  B.  J.  Dr.  and  Bunker,  W.  M. 

Dr. : "Prospects,  Problems  and  Performance  - a case  study  cf 

the  First  Pilot  Trainer  Using  CGI  Visuals,"  Proceedings  of 
the  Sixth  Naval  Training  Equipment  Center  and  Industry 
Conference,  NAVTRAEQUIPCEN  IH-226,  November  13,  1973. 

4.  Harris,  W.  T.:  "Device  2F90  Flying  Qualities  and  Perform- 

ance Evaluation  and  Discrepancy  Correction,"  NAVTRAEQUIPCEN 
Technical  Report  IH-245,  September  1975. 

SECTION  II 

5.  Anon:  MIL-T-23991,  Military  Specification  - "Training 

Devices  Military;  General  Specification  for” 

6.  Anon:  MIL-T-82335,  Military  Specification  - "Trainer,  Fixed 

Wing,  Flight;  General  Specification  For" 

7.  Anon;  MIL-T-9212,  Military  Specification  - "Trainer,  Flight 
Simulator,  Aircraft,  General  Requirements  For" 

8.  Anon;  SDC-911-600,  Department  of  the  Navy  Office  of  Naval 
Research  - Special  Devices  Center,  General  Specification  for 
Testing  of  Operational  Flight  Trainers  and/or  Tactics 
Trainers  Simulation,  15  August  1952. 

9.  Newell,  Fredrick  D. ; NAVTRADEVCEN  318-1,  "Final  Report 
Dynamic  Test  Program  for  Weapon  System  Trainers,"  April  1959 
(AD-228942) , Unclassified. 


NAVTRAEQUIPCEN  IH-251 


^ e 


I 

t 


10.  Newell,  Fredrick  D;  Schelhorn,  Amo  E.  : NAVTRADEVCEN  318-2 

"Final  Report  Phase  III;  Dynamic  Test  Program  for  Weapon 
System  Trainers,"  March  1961  (AD-323180),  Confidential. 


11.  Schelhorn,  Arno  E. : NAVTRADEVCEN  318-3  "Preliminary  Design 

Report  for  NTDC  Research  Model  Test  Equipment,"  February 
1960,  Unclassified. 


12.  Newell,  Fredrick  D.;  Schelhorn,  Arno  E.:  NAVTRADEVCEN  318-4, 

"Summary  Report  Phase  IV;  Dynamic  Test  Program  for  Weapon 
Systems  Trainers,"  June  1961  (AD-262667),  Unclassified. 

13.  Newell,  Fredrick  D.;  Schelhorn,  Arno  E.:  NAVTRADEVCEN  318-5, 

"Final  Report  Addendum:  Application  of  Dynamic  Test  Tech- 

niques to  Weapon  System  Trainers,"  September  1969  (AD-484396), 
Unclassified. 


14.  Anon;  U.S.  Naval  Training  Device  Center  31-610,  "General 
Specification  for  Functional  Test  Requirements  - Fixed  Wing 
Aircraft-Weapon  System  Trainers  (Flight),"  30  August  1963. 

15.  Anon:  MIL-STD-470  Military  Standard;  Maintainability  Pro- 

gram Requirements  (For  Systems  and  Equipments) . 

16.  Anon:  MIL-STD-471  Military  Standard;  Maintainability 

Demonstrations . 


17.  Anon;  MIL-STD-781  Military  Standards;  Reliability  Tests, 
Exponential  Distribution. 

18.  Anon;  MIL-STD-785,  Military  Standard;  Requirements  for 
Reliability  Program  (For  Systems  and  Equipments) . 

19.  Anon;  MIL-STD-826,  Military  Standard;  Electromagnetic 
Interference  Test  Requirements  and  Test  Methods. 

20.  Anon;  MIL-STD-876  (USAF) , Military  Standard;  Digital  Com- 
putation Systems  for  Real-time  Training  Simulators. 

21.  Langdon,  S.  D.  LCDR  USN,  "Fixed  Wing  Stability  and  Control 
Theory  and  Flight  Test  Techniques,"  Naval  Test  Pilot  School 
Flight  Test  Manual,  USNTPS-FTM-No  103,  August  1969. 

22.  Small,  S.  M. , LCDR  USN  and  Prueher,  J.  W. : "Fixed  Wing 

Performance  Theory  and  Flight  Test  Techniques,"  Naval  Test 
Pilot  School  Flight  Test  Manual  USNTPS-FTM  No  104,  July  1972. 

23.  Anon:  "Stability  and  Control,"  FTC-TlH-64-2004 , USAF  Aero- 

space Research  Pilot's  School,  Rev.  November  1964. 


1 


i 


86 


NAVTRAEQUIPCEN  IH-251 

24.  Jacobs,  W.  B.:  "Automated  Simulator  Test  and  Checkout," 

Goodyear  Engineering  Report  GER16011,  January  1974,  (Ref. 

IR  & D Project  No.  0509-73-D5)  Proprietary. 

SECTION  III 

SECTION  IV 

SECTION  V 

25.  Hutton,  D.  P.;  Burke,  D.  K.;  Englehart,  J.  D.;  Wilson  Jr.f 

J.  M. ; Romaglia,  F.  J. ; Schneider,  A.  J. : "Final  Report 

Project  2235,  Air-to-Ground  Visual  Simulation  Demonstration," 
P.  E.  64227F,  October  1976. 

26.  Harshbarger,  John  H.;  Gill,  Arthur  T. : "Development  of 

Techniques  for  Evaluation  of  Visual  Simulation  Equipment," 
AMRL-TDR-64-49,  August  1964. 

27.  Harshbarger,  John  H.:  "Test  and  Evaluation  of  Electronic 

Image  Generation  and  Projection  Devices  - Volume  I - Evalua- 
tion Technique,"  AMRL-TR-65-116 , Vol . I,  August  1965. 

28.  Harshbarger,  John  H.;  Basinger,  James  D.:  "Test  and  Evalua- 

tion of  Electronic  Image  Generation  and  Projection  Devices  - 
Volume  II  - Evaluation  of  Television  Systems, " AMRL-TR-65- 
116,  Volume  II,  November  1965. 

29.  Harshbarger,  John  H.;  Basinger,  James  D.:  "Test  and  Evalua- 

tion of  Electronic  Image  Generation  and  Projection  Devices  - 
Volume  III  - Evaluation  of  Projection  Screens,"  AMRI-TR-65- 
116,  Volume  III,  December  1965. 

30.  Driskell,  Carl  R. ; "Capabilities  in  Wide  Angle  Visual 
Technology,"  NAVTRAEQUIPCEN  IH-237,  December  1974. 

31.  Lindenberg,  Klaus;  "Objective  Evaluation  Method  for  Simula- 
ted Visual  Scenes  - Preliminary  Analysis,"  NAVTRAEQUIPCEN 
TN-47,  August  1976. 

32.  Borough,  H.  C.;  Fallis,  R.  F.;  Warnock,  R.  H.;  and  Britt, 

J.  H.:  "Quantitative  Determination  of  Image  Quality,"  Boeing 

Company  Report  D2-114058-1,  May  1967. 

33.  Klingberg,  C.  S.;  Elsworth,  C.  S.;  and  Filleau,  C.  R. : 

"Image  Quality  and  Detection  Performance  of  Military  Photo 
Interpreters,"  Boeing  Company  Report  D162-10323-1 , September 
1970. 

34.  Ewart,  Ronald  B.;  Harshbarger,  John  H.:  "Measurement  of 

Flight  Simulator  Visual  System  Performance,"  Journal  of  che 
Society  of  Photo-Optical  Instrumentation  Engineers  (SPIE) 
Volume  59  (1975)  Simulators  and  Simulation 


89 


NAVTRAEQUIPCEN  IH-2  51 


35.  MIL-STD-1558 , Military  Standard  - "Six-Degree-of-Freedom 
Motion  System  Requirements  for  Aircrewmember  Training  Simu- 
lators," February  1974. 

36.  Anon;  MIL-D-8708,  Military  Specifications;  Demonstration 
Requirements  for  Airplanes. 

37.  Grove,  Randall  D.,  and  Mayhew,  Stanley  C. : "A  Real-Time 

Digital  Program  for  Estimating  Aircraft  Stability  and  Control 
Parameters  from  Flight  Test  Data  by  using  the  Maximum  Likeli- 
hood Method,"  NASA  TMX-2788,  December  1973.  I 


I 


I 


90 


I 


NAVTRAEQUIPCEN  IH-251 


i 


APPENDIX  A 


RECOMMENDATION  FOR  SPECIFICATION  FOR 
FUNCTIONAL  TEST  REQUIREMENTS  FOR  EVALUATING 
FLYING  QUALITIES  AND  PERFORMANCE  OF  FIXED 
WING  AIRCRAFT  WEAPON  SYSTEM  TRAINERS 
AND  OPERATIONAL  FLIGHT  TRAINERS 


1 

i 


w 


91 


I 


I 


f 

i 


( 


NAVTRAEQUIPCEN  IH-251 

■ 

RECOMMENDATION  FOR  SPECIFICATION  FOR  7 

FUNCTIONAL  TEST  REQUIREMENTS  FOR  EVALUATING 
FLYING  QUALITIES  AND  PERFORMANCE  OF  FIXED  i 

WING  AIRCRAFT  WEAPON  SYSTEM  TRAINERS  s 

AND  OPERATIONAL  FLIGHT  TRAINERS  ; 


1.  SCOPE 

1.1  This  specification  contains  the  requirements  to  be  ful- 
filled in  evaluating  the  aerodynamic  flying  qualities  and  per- 
formance, and  engine  performance  of  fixed  wing  aircraft  Weapon 
System  Trainers  (WST)  and  Operational  Flight  Trainers  (OFT) . The 
requirements  consist  of  tests,  test  conditions,  test  configura- 
tions, test  methods,  and  tolerances  to  be  met. 

2 . APPLICABLE  DOCUMENTS 

2.1  The  following  documents  of  the  issue  in  effect  on^the 
date  of  invitation  for  bids  or  request  for  proposal,  form  a part 
of  this  specification  to  the  extent  specified  herein. 

SPECIFICATIONS 
Military 
MIL-D-8708 


MIL-F-8785 

MIL-T-23991 


MIL-T-29032 


PUBLICATIONS 

U.  S.  Naval  Air  Test  Center 

FTM-103  Fixed  Wing  Stability  and  Control 

Theory  and  Flight  Test  Techniques 

FTM-104  Fixed  Wing  Performance  - Theory  and 

Flight  Test  Techniques 


Demonstration  Requirements  for 
Aircraft 

Flying  Qualities  of  Piloted  Airplanes 

f 

Training  Devices,  Military;  General  |] 

Specification  for  ■■ 

Trainers,  Flight;  General  Specifica- 
tion for 


'f 
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USAF  Aerospace  Research  Pilot  School 

FTC-TlH-64-2004  Handbook  of  Stability  and  Control 

(Copies  of  specifications,  standards,  publications  and  drawings  required  by 
suppliers  in  connection  with  specific  procurement  functions  should  be  obtained 
from  the  procuring  activity  or  as  directed  by  the  Procuring  Contracting 
Officer.) 


2.2  Other  publications.-  The  following  documents  form  a part  of  this 
specification  to  the  extent  specified  herein.  Unless  otherwise  indicated, 
the  issue  in  effect  on  date  of  invitation  for  bids  or  request  for  proposal 
shall  apply: 

AMERICAN  SOCIETY  OF  MECHANICAL  ENGINEERS 

ASA  Y10.7  Letter  Symbols  for  Aeronautical 

Sciences 

(Application  for  copies  should  be  addressed  to  the  American  Society  of  Mechani- 
cal Engineers,  345  E.  47th  Street,  New  York,  NY  10017.) 

DEPARTMENT  OF  LABOR 

OSHA  Standard  1910.96  Ionizing  Radiation 

(Application  for  copies  should  be  addressed  to  ttie  Superintendent  of  Documents, 
U.  S.  Government  Printing  Office,  Washington,  DC  20402.) 

(Technical  Society  and  technical  association  specifications  and  standards 
are  generally  available  for  reference  from  libraries.  They  are  also 
distributed  among  technical  groups  and  using  Federal  agencies.) 

3.  REQUIREMENTS 

3.1  Application.-  The  functional  test  requirements  specified  herein 
cover  the  tests  to  be  performed,  the  test  configurations,  the  test  procedures, 
and  the  data  which  shall  be  recorded.  The  requirements  provide  a uniform 
method  for  direct  comparison  of  the  flight  performance,  flying  qualities,  and 
engine  performance  of  the  WST  or  OFT  with  the  test  results  of  the  aircraft. 

3.1.1  Prototype  trainers.-  Tests  conducted  on  prototype  trainers  shall 
consist  of  all  tests  specified  in  4,  and  such  additional  functional  tests 
which  may  be  required  in  accordance  with  the  detail  trainer  specification 
to  demonstrate  conformance  with  the  test  results  of  the  aircraft. 

3.1.2  Production  trainers.-  For  production  trainers,  tests  shall  be 
conducted  from  4 to  demonstrate  conformance  to  the  test  results  of  the  proto- 
type trainer.  The  areas  of  4 to  be  conducted  are  designated  by  an  asterisk  (*). 
Additional  functional  testing  may  be  required  in  accordance  with  the  detail 
trainer  specification. 

3.2  Performance  of  tests.-  Tests  specified  herein  shall  be  conducted 

by  the  contractor,  subsequent  to  completion  of  the  quality  assurance  provisions 
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of  MIL-T-23991,  and  prior  to  the  NAVTRAEQUIPCEN  Representative's  test  and 
acceptance  program.  All  required  tests  shall  be  validated  and  certified 
by  a Government  inspector.  This  certification  shall  consist  of  initialing 
all  original  data  sheets  used  in  the  tests.  A copy  of  these  data  sheets 
shall  be  provided  to  the  Government  inspector  by  the  contractor.  When  changes 
or  recalibration  for  alignment,  equipment  failure  or  adjustment  purposes  are  made 
during  the  test  programs,  such  changes  shall  be  recorded  on  the  data  sheets. 

Tests  which  may  have  been  conducted  prior  to  such  adjustments  shall  be  repeated 
unless  conclusive  proof  can  be  provided  that  such  adjustments  have  not  invali- 
dated the  recorded  test  data  up  to  the  time  of  such  adjustments.  Upon  the 
successful  completion  of  the  tests  specified,  the  trainer  shall  be  made  avail- 
able to  the  NAVTRAEQUIPCEN  Technical  Representative  for  his  test  and  acceptance 
program. 

3.3  Test  equipment,  programs  and  instrumentation. The  contractor  shall 

supply  all  test  equipment,  programs  and  instrumentation  necessary  to  conduct 
the  various  tests  accurately  and  expeditiously.  Test  equipment  and  programs 
shall  include,  but  not  be  limited  to:  means  for  introducing  pulse,  step, 

) and  sinusoidal  disturbances  of  simulated  flight  control  surface  deflections, 

equipment  for  measuring  time,  control  forces  and  deflections,  and  equipment 
for  real  time  data  recording  of  up  to  twelve  flight  variables  simultaneously. 
Additional  programming  required  shall  provide  the  capability  to  command 
straight  and  level  flight  at  predetermined  flight  conditions.  The  capability 
shall  exist  to  vary  airspeed  while  automatically  maintaining  trimmed  flight. 

The  capability  to  individually  or  collectively  freeze  roll,  pitch,  yaw,  X, 

Y,  and  Z shall  be  provided.  All  such  equipment  and  programs  shall  be  checked 
or  calibrated  within  one  month  prior  to  conducting  the  test  program.  A list 
of  all  test  equipment  and  conversion  data  shall  be  included  in  the  Test  Pro- 
cedures and  Results  Report. 

3.4  Reporting  of  results.-  Test  results  shall  be  prepared  in  accordance 
with  the  following: 

3.4.1  Test  procedure  format. - 


(a)  Title  of  test  - including  subparagraph  number 

(b)  Purpose  - A statement  of  what  the  test  is  intended  to 
accomplish 


(c) 


(d) 

(e) 


Test  Method  - a statement  indicating  how  the  test  is  to  be 
performed,  including  calculations,  formulae,  and  conversion 
factors  required  to  correlate  test  measurements  with  specif  — 
test  criteria.  When  two  or  more  quantitative  readings  a-e 
required  simultaneously,  the  method  of  utilizing  a plo^-  r 
data  recording  and  computer  printout  shall  be  descriL- 

Test  equipment  and  software  test  aids  required  - 1 
points,  setup  adjustment,  and  implementing  ins? 

Initial  conditions  - include  simulator  *v  - 
altitude,  speed,  gross  weight,  center  ‘f  . 
of  controls  and  the  like  prior  to  - fi 
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(f)  Additional  requirements  - discuss  personnel  required  to  conduct 
the  testing,  potential  hazards  to  personnel  performing  the 
testing,  and  the  like 

(g)  Test  procedures  - detailed  step-by-step  procedures  are  required 

(h)  Reference  aircraft  test  data  to  which  comparison  is  being  made. 

3.4.2  Tabular  format.-  The  tabular  format  of  test  procedures  shall  use 
the  following  headings: 

(a)  Test  item  number 

(b)  Specification  reference  - test  identification 

(c)  NATOPS  flight  handbook  or  other  aircraft  reference  data 

(d)  Control  action 

(e)  Expected  results  including  tolerances 

(f)  Results/remarks. 

3.4.3  Test  data.-  The  simulator  test  data  shall  be  presented  as  curves, 
tables,  or  data  entries  as  specified  herein. 

3.4.4  Reference  data.-  Simulator  test  criteria  shall  be  limited  to 
measured  test  data  as  recorded  from  testing  of  the  reference  aircraft. 

3.4.5  Tolerances.-  All  tolerances  shall  be  in  accordance  with  the  detail 
specification  and  MIL-T-29032.  The  simulator  performance  shall  equal  the 
test  criteria  of  3.4.4  plus  or  minus  the  specified  tolerances. 

3.4.6  Test  grouping.-  In  this  specification,  tests  have  been  grouped  into 
static  or  steady  state  tests  and  dynamic  or  transient  tests,  for  convenience. 
The  tests  as  performed  by  the  contractor  shall  be  sequenced  in  such  a manner 
as  to  prevent  redundancies  of  tests  and  to  permit  a maximum  amount  of  data 
acquisition  in  a minimum  of  time.  For  example,  engine  steady  state  testing 
and  longitudinal  trim  testing  may  be  simultaneously  conducted. 

3.5  Revision  of  test  requirements.-  Requests  for  changes  (revisions, 
deviations,  or  additions),  to  requirements  specified  herein,  deemed  necessary 
to  completely  verify  the  simulation  of  the  aircraft  shall  be  presented  at 
the  time  when  the  proposed  criteria  reports  are  submitted  for  approval.  All 
such  requests  shall  be  substantiated  by  pertinent  facts,  in  writing,  to  the 
Contracting  Officer  for  approval. 

4.  INSPECTIONS  AND  TEST  PROCEDURES 

4.1  Responsibility  for  inspection.-  Unless  otherwise  specified  in  the 
contract  or  purchase  order,  the  supplier  is  responsible  for  the  performance 
of  all  inspection  requirements  as  specified  herein.  The  Government  reserves 
the  right  to  perform  any  additional  inspections  necessary  to  assure  that 
supplies  and  services  conform  to  contracted  requirements. 
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4.2  Conditions  and  configurations.-  MIL-D-8708  and  MIL-F-8785  specify 
demonstration  requirements  for  aircra'ft  in  general.  In  the  preparation 
of  the  flight  trainer  test  requirements,  specific  conditions  and  configura- 
tions required  in  the  aircraft  test  specification  addendum  to  MIL-D-8708  shall 
be  utilized  to  facilitate  correlation  between  trainer  and  aircraft  demonstra- 
tion results.  Exceptions  to  the  use  of  aircraft  test  data  shall  be  identified 
and  justified  by  the  contractor  90  days  prior  to  test  guide  submission. 

Preferred  conditions  for  testing  to  conditions  other  than  those  of  the  adden- 
dum to  MIL-D-8708  are  shown  in  table  Al. 

4.2.1  Terms  and  symbols.-  Terms  used  herein  and  in  reporting  results, 
other  than  those  defined  within  the  specific  requirement,  shall  be  in  accord- 
ance with  6.2.  The  symbols  used  herein  and  in  reporting  results,  other  than 
those  defined  within  the  specific  requirement,  shall  be  in  accordance  with  the 
American  Standards  Association  Y10.7,  "Letter  Symbols  for  Aeronautical  Science." 

4.2.2  Testing  method  references.-  Testing  methodologies  may  vary 
somewhat  from  simulator  to  simulator  depending  upon  the  type  of  aircraft 
being  simulated.  Any  procedure  normally  used  in  aircraft  flight  testing 
may  be  used  in  simulator  testing;  however,  when  preferred  methods  exist, 

they  are  shown  in  table  I and  may  be  found  in  the  following  testing  references: 

(a)  FTM  No.  103,  "Fixed  Wing  Stability  and  Control  Theory  and 
Flight  Test  Techniques",  U.S.  Naval  Test  Pilot's  School  Flight 
Test  Manual,  August  1969 

(b)  FTM  No.  104,  "Fixed  Wing  Performance  - Theory  and  Flight  Test 
Techniques",  U.S.  Naval  Test  Pilot's  School  Flight  Test  Manual, 
July  1972 

(c)  FTC-TlH-64-2004,  "Handbook  of  Stability  and  Control",  U.S.  Air 
Force  Research  Pilot's  School. 

Computer  aided  testing  may  be  used  for  simulator  testing  provided  the  results 
may  be  referenced  to  aircraft  reference  data. 

4.3  Required  testing  program.-  The  following  areas  of  flying  qualities 
and  performance  and  engine  performance  shall  be  tested.  Table  Al  specifies 
the  tests,  conditions  (if  not  covered  in  MIL-D-8708  addenda)  and  recommended 
testing  techniques  when  they  exist. 

4.3.1  Preliminary  tests. - 

* 4. 3. 1.1  Control  systems.-  Mechanical  characteristics  of  all  trim  and 
control  systems.  Determine: 

(a)  Breakout  and  friction  forces 

(b)  Freeplay 

(c)  Control  centering 

(d)  Dynamic  properties  - damping  and  natural  frequency 
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(e)  Configuration  dimensionality 

(f)  Control  force  versus  control  deflection 

(g)  Control  deflection  versus  trim  actuation  (statics) 

(h)  Surface  deflection  versus  control  deflection 

(i)  Control  deflection  parameterized  agains-t  actuation  of 
appurtenances  - speedbrakes,  wingflaps,  radome,  etc. 

(j)  Trim  characteristics  - control  position  as  a function  of  trim 
actuation  (dynamics,  rough  spots,  backlash,  etc.) 

(k)  Time  histories  of  control  deflection  and  force,  surface 
deflection  and  trim  actuation. 

* 4. 3. 1.2  Weight  and  balance.-  Weight  and  balance  testing  shall  be  com- 
pleted prior  to  flying  quality  or  performance  testing.  Determine: 

Center  of  gravity  versus  gross  weight. 

4.3.2  Flying  qualities. - 

4.3.2. 1 Longitudinal  stability  and  control. - 

* 4. 3. 2. 1.1  Steady  state  trim  points. - 

(a)  Angle  of  attack  versus  trim  airspeed  (IAS  or  mach) 

(b)  Control  deflection  versus  trim  airspeed  (IAS  or  mach) 

(c)  Trim  surface  deflection  versus  trim  airspeed  (IAS  or  mach) 

(d)  Optimum  approach  airspeed  versus  gross  weight 

(e)  Optimum  approach  airspeed  trim  surface  incidence  versus  gross 
weight. 

* 4. 3. 2. 1.2  Longitudinal  trim  changes  due  to  changes  in  thrust  and 
activation  of  appurtenances. - 

(a)  Change  in  control  position,  control  force,  pitch  angle,  angle 
of  attack,  altitude,  and  air  speed  required  to  maintain  the 
conditions  specified  in  table  II  following  individual  activa- 
tion of  all  appurtenances 

(b)  Changes  in  control  position,  control  force,  pitch  angle,  angle 
of  attack,  altitude,  and  airspeed  required  to  maintain  level 
flight  following  activation  of  all  appurtenances  not  mentioned 
in  table  II;  for  example,  wing  sweep  changes,  retractable  ra- 
domes,  expendable  external  fuel  tanks  and  stores,  etc. 
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* 4. 3. 2. 1.3 


(a) 

(b) 

(c) 

(d) 


(a) 

(b) 

(c) 


* 4. 3. 2. 1.5 

(a) 


Static  longitudinal  stability.-  Determine: 

Control  deflection  versus  airspeed  (IAS  or  mach) 

Control  force  versus  airspeed  (IAS  or  mach) 

Angle  of  attack  versus  airspeed  (IAS  or  mach) 

Rate  of  climb  versus  airspeed  (PA  configuration  only,  IAS). 
Maneuvering  stability.-  Determine: 

Control  deflection  versus  normal  acceleration 
Control  force  versus  normal  acceleration 
Angle  of  attack  versus  normal  acceleration. 

Dynamic  longitudinal  stability.-  Determine: 

Short  period  frequency  versus  airspeed  (IAS  or  mach) 


i ■' 


(b)  Short  period  damping  versus  airspeed  (IAS  or  mach) 

(c)  Phugoid  frequency  versus  airspeed  (IAS  or  mach) 

(d)  Phugoid  damping  versus  airspeed  (IAS  or  mach) 

(e)  Time  phase  relationships  of  control  deflection,  control  force, 
surface  deflection,  pitch  angle  and  rate,  angle  of  attack, 
normal  acceleration,  rate  of  climb  and  airspeed  (or  mach). 
(Time  phase  testing  for  medium  CR  and  PA  runs  only).  Time  to 
first  peak 

(f)  Short  period  at  normal  accelerations  greater  than  1 for  medium 
GW,  medium  altitude  runs  only  versus  normal  acceleration. 

4. 3. 2. 2 Lateral -directional  stability  and  control. - 


i 


* 4. 3. 2. 2.1  Static  lateral-directional  stability. - 


Rudder  control  deflection  and  force,  aileron  control  deflection 
and  force,  roll  angle  and  longitudinal  control  deflection 
versus  sideslip  angle. 

* 4. 3. 2. 2. 2 Dynamic  lateral -directional  stability.- 

(a)  Dutch  roll  period  and  damping  versus  airspeed  (IAS  or  mach) 

(b)  Spiral  stability  (control  deflection,  heading  and  bank  angle 
versus  time) 
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(c)  Roll  response  (control  deflection,  heading,  roll  angle,  and  rate 
versus  time  for  full  and  partial  deflection.  Partial  inputs 

shall  be  less  than  10  percent  of  full  deflection) 

(d)  Time  phase  relationships  of  control  deflection,  control  force, 
surface  deflection,  roll  angle,  roll  rate,  sideslip  angle,  and 
heading  angle 

(e)  Roll  to  yaw  ratio. 

4. 3. 2. 3 Engine  out  flying  qualities.- 

(a)  Minimum  control  ground  speed 

(b)  Minimum  control  airspeed  (static  and  dynamic) 

(c)  Time  phase  sequences  during  engine  failure  (plots  of  power 
lever  angle,  blade  angle,  roll,  pitch  and  yaw  angles,  longi- 
tudinal, lateral  and  directional  control  deflection  versus 
time) 

(d)  Plots  of  lateral  and  directional  control  deflection  and  force, 
sideslip,  and  pitch  angles  versus  roll  angle.  Record  power 
setting. 

4. 3. 2. 4 Ground  handling  characteristics. - 

(a)  Nose  gear  steering  effectiveness 

Plots  of  heading  versus  time  parameterized  against  percent 
application  of  nose  gear  steering  and  taxi  speed 

(b)  Brake  effectiveness 

(1)  Plots  of  heading  versus  time  parameterized  against 
amount  of  asymmetrical  brake  application 

(2)  Plots  of  ground  speed  versus  time  parameterized  against 
symmetrical  brake  application 

(c)  Aileron  effectiveness  speed 

(d)  Rudder  effectiveness  speed. 

4.3.3  Performance . - 

4. 3. 3.1  Airframe  properties.- 

4. 3. 3. 1.1  Takeoff  characteristics. - 

* (a)  Nosewheel  liftoff  speed  versus  gross  weight 
(b)  Time  to  reach  nosewheel  liftoff  speed  versus  gross  weight 
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(c)  Attitude  of  takeoff  (plots  of  airspeed,  rate  of  climb,  longi- 
tudinal, lateral  and  directional  control  deflection,  pitch 
angle  and  angle  of  attack  versus  time) 

* (d)  Technique  of  takeoff  (qualitative) 

(e)  Crosswind  takeoff  (qualitative) 

* (f)  Catapult  launch  (qualitative). 

4. 3. 3.1 .2  Inflight  character istics.- 

* (a)  Level  acceleration 

Plots  of  airspeed  (IAS  or  mach)  versus  time 

* (b)  Level  deceleration 

Plots  of  airspeed  (IAS  or  mach)  versus  time  with  and 
without  speed  brakes 

(c)  Maximum  speed  per  configuration  for  level  flight 

* (d)  Climb  performance 

(1)  Plots  of  altitude  versus  time 

(2)  Plots  of  rate  of  climb  versus  airspeed  (IAS  or  mach) 

(e)  Stall  characteristics 

(1)  One  g stalls  - stall  angle  of  attack,  plot  stall  speed 
versus  gross  weight 

(2)  Accelerated  stalls  - stall  angle  of  attack  and  the  product 
of  normal  acceleration  times  gross  weight  (n  x GW)  versus 
Mach  or  airspeed 

(3)  Buffet  boundary  - plot  angle  of  attack  and  (n  x GW)  versus 
Mach  or  airspeed  for  onset  and  limit  buffet  for  one  g and 
accelerated  stalls 

(f)  Stall  and  spin  effects 

Plots  of  angle  of  attack,  speed,  heading  angle  and  rate, 
sideslip  angle,  pitch  angle  and  rate,  roll  angle  and  rate, 
and  altitude  versus  time  during  the  stalls  and  spins. 

4. 3. 3. 1.3  Landing  characteristics. - 
(a)  Ground  effects 

(1)  Ground  effects  hold  off  speed  (IAS) 
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(2)  Qualitative  evaluation  of  pitch  and  rate  of  climb  (descent) 
control 

(3)  Plot  longitudinal  control  deflection  versus  angle  of  attack 

* (b)  Landing  time  histories  and  aerodynamic  braking 

(1)  Plots  of  angle  of  attack,  altitude,  rate  of  climb,  airspeed/ 
groundspeed,  pitch  angle,  longitudinal  control  deflection, 
and  spoiler  deflection  versus  time  during  normal  landings 

* (c)  Drag  chute  operation  (if  applicable)  - qualitative  evaluation 

* (d)  Tail  hook  operation  (if  applicable)  - qualitative  evaluation 

* (e)  Spoiler  operation  (if  applicable)  - qualitative  evaluation. 

4. 3. 3. 1.4  Engine-out  performance. - 

(a)  Acceleration 

Plots  of  airspeed  (IAS  or  mach)  versus  time 

(b)  Climb  performance 

(1)  Altitude  versus  time 

(2)  Rate  of  climb  versus  airspeed. 

4. 3. 3. 2 Engine. - 

4. 3. 3. 2.1  Engine  statics.-  For  standard  day  and  standard  day  plus  or 
minus  50“F  determine: 

* (a)  Thrust  (or  power  for  propeller  driven  aircraft)  available 

All  pertinent  engine  variables  versus  mach  (or  IAS)  para- 
meterized against  altitude  and  powe>"  lever  position 

* (b)  Thrust  required  - stabilized  level  flight 

All  pertinent  engine  variables  versus  mach  (or  IAS)  para- 
meterized against  altitude  for  stabilized  level  flight 

* (c)  Pertinent  engine  variables  as  a function  of  power  lever  angle 

at  sea  level,  mach  equal  zero 

(d)  Afterburner  envelope  - ignition  possible  envelope  and  blowout 
envelope 

(e)  Air  start  envelope  (mach  altitude  plane) 

(f)  Windmilling  rpm  versus  mach  (or  IAS)  parameterized  against 
alti tude. 
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4. 3. 3. 2. 2 Engine  dynamics. - 


(a)  Starting  characteristics 

Plot  all  pertinent  engine  variables  versus  time  for  all 
starting  methods  (normal  and  emergency) 

* (b)  Acceleration/deceleration  characteristics  for  large  (full)  and 
and  small  Oess  than  10  percent  of  full  throw)  power  lever  ex- 
cursions, particularly  about  the  optimum  approach  speed  power 
settings 

Plots  of  all  pertinent  engine  variables  versus  time 
(c)  Power  down  characteristics 


Plots  of  all  pertinent  engine  variables  versus  time. 


5.  PACKAGING.  This  section  is  not  applicable. 

6.  NOTES 

6.1  Intended  use.-  This  specification  is  intended  to  provide  the  general 
flying  qualities  and  performance  test  requirements  for  aircraft  flight  train- 
ers and  to  serve  as  a basis  for  the  preparation  of  the  test  procedure  and  test 
results  reports  which  can  be  directly  compared  with  appropriate  aircraft  test 
results. 


6.2  Definitions.-  Terms  and  symbols  used  throughout  this  specification 
are  defined  as  follows: 

6.2.1  General 

(a)  Altitude.-  All  altitudes  specified  herein  are  pressure  alti- 
tudes. Several  altitudes  used  are: 

(1)  - Maximum  service  altitude.  The  maximum  service 
iiiax 

altitude  for  a given  speed  is  the  maximum  altitude  at 
which  a rate  of  climb  of  100  feet  per  minute  can  be  main- 
tained in  unaccelerated  flight  with  MAT 

(2)  h . . - 1/2  h„^, 

mid  max 

(3)  h - Maximum  operational  altitude 

°max 

(4)  h - Minimum  operational  altitude 

°min 

(5)  MSL  - Mean  Sea  Level 

(b)  Appurtenance  - Any  pilot  activated  device  which  disrupts  the 
equilibrium  flight  of  the  aircraft.  For  example:  Landing  gear, 
wing  flaps,  speed  brakes,  extendable  radomes,  MAO  booms,  swing 
wings  and  the  like 
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(c)  c.g.  - Aircraft  center  of  gravity 

(d)  Configurations  - Simulated  aircraft  components  such  as  landing 
gear,  wing  flaps,  cowl  flaps,  oil  radiator  flaps  and  shutters, 
controllable  wing  slots,  gun  turrets,  blast  tube  covers,  etc., 
will  be  in  their  normal  settings  for  the  particular  configura- 
tions. For  aircraft  equipped  with  external  droppable  stores, 
stability  and  control  requirements  will  be  met  with  stores  both 
attached  and  removed  in  configurations  P,  CR,  L,  PA,  and  TO 

(1)  Configuration  CR,  Cruise  - Power  for  level  flight  at 
trim  speed,  flaps  in  cruise  position,  and  gear  up 

(2)  Configuration  L,  Landing  - Idle  power,  flaps  and  gear 
down,  or  other  high  lift  devices  at  landing  setting 

(3)  Configuration  P,  Power-on  Clean  - Normal  rated  power, 
flaps  and  gear  up 

(4)  Configuration  PA,  Power  Approach  - Power  for  level  flight 
at  1.15Vg(L)  or  normal  approach  speed,  whichever  is  lower, 

flaps  and  gear  down,  other  high  lift  devices  in  normal 
approach  position 

(5)  Configuration  TO,  Take-off  - Take-off  power,  high  lift 
devices  and  gear  in  normal  take-off  position 

(e)  Control  parameters.- 

(1)  Controls  - The  stick  or  wheel  and  rudder  pedals  manipulated 
by  the  pilot  to  produce  pitching,  rolling,  and  yawing 
moments  respectively;  the  cockpit  controls 

(2)  Longitudinal  control  force  - Component  of  applied  force, 
exerted  by  the  pilot  on  the  cockpit  control,  in  or  parallel 
to  the  plane  of  symmetry,  acting  at  the  center  of  the 
stick  grip  or  wheel  in  a direction  perpendicular  to  a 

line  between  the  center  of  the  stick  grip  or  wheel  and  the 
stick  or  control  column  pivot 

(3)  Lateral  control  force  - For  a stick  control,  the  component 
of  control  force  exerted  by  the  pilot  in  a plane  perpen- 
dicular to  the  plane  of  symmetry,  acting  at  the  center 

of  the  stick  grip  in  a direction  perpendicular  to  a line 
between  the  center  of  the  stick  grip  and  the  stick  pivot. 

For  a wheel  control,  the  total  moment  applied  by  the  pilot 
about  the  wheel  axis  in  the  plane  of  the  wheel,  divided 
by  the  average  radius  from  the  wheel  pivot  to  the  pilot's 
grip 

(4)  Directional  pedal  force  - Difference  of  push-force  components 
of  forces  exerted  by  the  pilot  on  the  rudder  pedals,  lying 

in  planes  parallel  to  the  plane  of  symmetry,  measured 
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perpendicular  to  the  pedals  at  the  normal  point  of  appli- 
cation of  the  pilot's  instep  on  the  respective  rudder 
pedal s 

(5)  Control  surface  - A device  such  as  an  external  surface  which 
is  positioned  by  a cockpit  control  or  stability  augmentation 
to  produce  aerodynamic  or  jet-reaction  type  forces  for 
controlling  the  attitude  of  the  airplane.  As  used  in  this 
specification  the  elevator  surface,  aileron  surface,  and 
rudder  surface  are  the  control  surfaces  or  devices  which 
are  controlled  by  the  stick  or  wheel  and  rudder  pedals, 
and  automatically  by  stability  augmentation  system 

(f)  GW  - Gross  weight 

(g)  N - Normal  acceleration 

(1)  n(+),  n(-)  - For  a given  altitude,  the  upper  and  lower 

boundaries  of  n in  the  V-n  diagrams  depicting  the  Service 
Flight  Envelope 

*^0  ’ % " minimum  Operational  load  factors 

°max  °min 

(3)  ® given  altitude,  the  upper  and  lower 

boundaries  of  n in  the  V-n  diagrams  depicting  the  Operational 
Flight  Envelope 

(h)  Operational  Flight  Envelopes.-  The  Operational  Flight  Envelopes 
define  the  boundaries  in  terms  of  speed,  altitude,  and  load 
factor  within  which  the  airplane  must  be  capable  of  operating  in 
order  to  accomplish  its  missions.  Envelopes  for  each  applicable 
Flight  Phase  shall  be  established  with  the  guidance  and  approval 
of  the  procuring  activity 


(i)  Pertinent  engine  variables.-  Those  parameters  that  are  discernible 
to  the  pilot  and  also  vary  with  engine  controls  position,  Mach 
number,  altitude  or  governing  apparatus  such  as  RPM  and  tail 
pipe  temperature  limiting  devices.  Sample  pertinent  engine 
variables  might  include: 

Jet  Turboprop  Reciprocating 


RPM  (Compressor, 
turbine,  etc.) 


RPM  (Turbine, 
propeller,  etc.) 


RPM  (Engine, 
propeller,  etc.) 


Fuel  flow 


Nozzle  area 


Exhaust  gas  temp. 


Fuel  flow 


Cylinder  head 
temperature 


Indicated  shaft  Mixture  control 

horse-power 

Engine  pressure  ratio  Propeller  control 
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Turbine  inlet  temp.  Torque 


Power  lever  angle 
Oil  temperature 
Oil  pressure 

Thrust 

Pressure  ratio 


Turbine  inlet  tempera- 
ture 

Fuel  pressure 


Turbine  inlet  temp. 


Exhaust  gas  temp. 

Power  lever  angle 
Thrust 


Manifold  pressure 

Oil  temperature 
Oil  pressure 


Power  lever  angle 


The  exact  variables  will  depend  on  the  engine  being  simulated 

(j)  Speed  - Airspeed  or  ground  speed.  Where  appropriate,  air  speed 
may  be  replaced  by  Mach 

(1)  - Maximum  service  speed  - The  maximum  service  speed, 

Vmax  ^ax’  altitude  is  the  lowest  of: 

a.  The  maximum  permissible  speed 

b.  A speed  which  is  a safe  margin  below  the  speed  at  which 
intolerable  buffet  or  structural  vibration  is  encountered 

c.  The  maximum  airspeed  at  MAT,  for  each  altitude,  for 
dives  (at  all  angles)  from  at  all  altitudes,  from 


1 

which  recovery  can  be  made  at  2,000  feet  above  MSL  or  ^ 
higher  without  penetrating  a safe  margin  from  loss  of  ’ 
control,  other  dangerous  behavior,  or  intolerable  ‘ 
buffet,  and  without  exceeding  structural  limits  < 

(2)  V . - Minimum  service  speed  - The  minimum  service  speed, 

mm 

'^min  ^in  , for  each  altitude  is  the  highest  of: 

t 

a. 

1.1.  V5 

1 

b. 

Vc  + 10  knots  equivalent  airspeed 
J 

c. 

The  speed  below  which  full  airplane-nose-up  elevator 
control  power  and  trim  are  insufficient  to  maintain 
straight,  steady  flight 

1 

d. 

The  lowest  speed  at  which  level  flight  can  be  main- 
tained with  MRT 

■ 

e. 

A speed  limited  by  reduced  visibility  or  an  extreme 
pitch  attitude  that  would  result  in  the  tail  or  aft 
fuselage  contacting  the  ground 



t 


I 


I 
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(3)  Minimum  permissible  speed  other  than  stall  - For  some 
airplanes,  considerations  other  than  maximum  lift  determine 
the  minimum  permissible  speed  in  Ig  flight  (e.g.,  ability 
to  perform  altitude  corrections,  excessive  sinking  speed, 
ability  to  execute  a wave-off  (go-around),  etc.)*  In  such 
cases,  an  arbitrary  angle-of-attack  limit,  or  similar 
minimum  speed  and  maximum  load  factor  limits,  shall  be 
established  for  the  Permissible  Flight  Envelope,  subject 

to  the  approval  of  the  procuring  activity.  This  defined 
minimum  permissible  speed  shall  be  used  as  in  all 
applicable  requirements 

(4)  - High  speed,  level  flight,  normal  rated  thrust 

(5)  - High  speed,  level  flight,  military  rated  thrust 

(6)  - High  speed,  level  flight,  maximum  augmented  thrust 

(7)  V - Maximum  operational  speed 

°max 

(8)  V - Minimum  operational  speed 

°min 

(9)  Vj  - Stall  speed  (equivalent  airspeed),  at  Ig  normal  to 
the  flight  path,  defined  as  the  highest  of: 

a.  Speed  for  steady  straight  flight  at  , the  first 

max 

local  maximum  of  the  curve  of  lift  coefficient  (L/qS) 
vs.  angle  of  attack  which  occurs  as  C.  is  increased 
from  zero 

b.  Speed  at  which  abrupt  uncontrollable  pitching,  rolling 
or  yawing  occurs,  i.e.,  loss  of  control  about  a 
single  axis 

c.  Speed  at  which  intolerable  buffet  or  structural 
vibration  is  encountered 

(10)  V^(X),  V^^^(X),  V^aj^(X)  - Shorthand  notation  for  the 

speeds  V^,  for  a given  configuration,  weight, 

center-of-gravity  position,  and  external  stores  combination 
associated  with  Flight  Phase  X.  For  example,  the  designa- 
tion V„,,„(T0)  (for  the  weight,  center-of-gravity  and  exter- 

nal  stores  combination  under  consideration)  is  V for  the 
configuration  associated  with  the  takeoff  Flight"^®^  Phase 

(k)  Thrust  and  power. - 


(1)  Thrust  and  power  - For  propeller-driven  airplanes,  the  word 
"thrust"  shall  be  replaced  by  the  word  "power"  throughout 
the  specification 
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(2)  TLF  - Thrust  for  level  flight 

(3)  NRT  - Normal  rated  thrust,  which  is  the  maximum  thrust 
at  which  the  engine  can  be  operated  continuously 

(4)  MRT  - Military  rated  thrust,  which  is  the  maximum  thrust 
at  which  the  engine  can  be  operated  for  a specified  period 

(5)  MAT  - Maximum  augmented  thrust:  maximum  thrust,  augmented 

by  all  means  available  for  the  Flight  Phase 

(6)  Takeoff  thrust  - Maximum  thrust  available  for  takeoff. 


107 


TABLE  Al.  FLYING  QUALITY  AND  PEFFORMANCE  TESTING 


TABLE  Al.  FLYINH  QUALITY  AND  PERFORMANCE  TESTING  (Continued) 


failed  sep- 
arately and 
jointly. 
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TABLE  A2.  Pitch  Trim  Change  Conditions 


Initial  Tria  Coalition 

Altitude  Speed  Landing  Hlfh*lift  Thniat  Configuration  Paraaeter 
Phase  Cear  Devices  Change  to  be  held 

I Ifing  constant 


TLF 

Cear  down 

TLF 

Cear  de^n 

TLF 

Extend  high- 
lift  devices 
and  wing 
flaps 

TLF 

Extend  high- 
lift  devices 
and  wing 
flaps 

TLF 

Idle  thrust 

1 

TLF 

Extend 

approach  drag 
device 

TLF 

Takeoff 

thrust 

TLF 

Takeoff 
thrust  plus 
normal  clean- 
up for  wave- 
off  (go- 
around) 

Take- 

off 

thrust 

Cear  up 

Take- 

off 

thrust 

1 

Retract  high- 
lift  devices 
and  wing 
flaps 

Wl  1 

Idle  thrust 

MRT 

Actuate  de- 
celeration 
device 

NRT 

>Uximum 

augmented 

thrust 

TLF 

Actuate  de- 
celeration 
device 

Throttle  setting  aa)r  be  changed  during  the  naneuver 

Kotes:  - Auxiliary  drag  devices  are  Initially  retracted,  and  all  details  of 

not  specifically  acntiened  are  noraal  for  the  Flight  Phase. 

- If  power  reduction  is  pemltted  In  aeeting  the  deceleration  requireaents 
established  for  the  aiaslon.  actuation  of  the  deceleration  device  in 
tli  and  «14  ahatl  be  acceopanied  by  the  allowable  power  reduction. 
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RECOMMENDATION  FOR  SPECIFICATION  FOR 
FUNCTIONAL  TEST  REQUIREMENTS  FOR  EVALUATING 
COCKPIT  MOTION  SYSTEMS  AS  USED  WITH 
AIRCRAFT  WEAPON  SYSTEM  TRAINERS  AND 
OPERATIONAL  FLIGHT  TRAINERS 
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RECOMMENDATION  FOR  SPECIFICATION  FOR 
FUNCTIONAL  TEST  REQUIREMENTS  FOR  EVALUATING 
COCKPIT  MOTION  SYSTEMS  AS  USED  WITH 
AIRCRAFT  WEAPON  SYSTEM  TRAINERS  AND 
OPERATIONAL  FLIGHT  TRAINERS 


1 . SCOPE 


1.1  This  specification  contains  the  requirements  to  be  ful- 
filled in  evaluating  the  engineering  performance  of  cockpit 
motion  systems  as  used  with  Weapon  System  Trainers  (WST)  and 
Operational  Flight  Trainers  (OFT) . The  requirements  consist  of 
tests,  test  conditions,  test  configurations,  test  methods,  and 
tolerances  to  be  met. 

2 . APPLICABLE  DOCUMENTS 

2.1  The  following  documents  of  the  issue  in  effect  on  the 
date  of  invitation  for  bids  or  request  for  proposal,  form  a part 
of  this  specification  to  the  extent  specified  herein. 

SPECIFICATIONS 

Military 

MIL-T-23991  Training  Devices,  Military;  Gen- 

eral Specification  for 

STANDARDS 

Military 

MIL-STD-1472  Human  Engineering  Design 

Criteria  for  Military  Systems, 
Equipment,  and  Facilities 

(Copies  of  specifications,  standards,  publications,  and  drawings 
required  by  suppliers  in  connection  with  specific  procurement 
functions  shall  be  obtained  from  the  procuring  activity  or  as 
directed  by  the  Contracting  Officer.) 

3.  REQUIREMENTS 

3.1  Application.-  The  functional  test  requirements  specified 
herein  cover  the  tests  to  be  performed,  the  test  configurations, 
the  test  procedures,  and  the  data  which  shall  be  provided.  The 
requirements  provide  a uniform  method  for  direct  comparison  of 
the  cockpit  motion  system  with  the  test  criteria  data. 


114 


NAVTRAEQUIPCEN  IH-251 


r 


3.1.1  Prototype  trainers.-  Tests  conducted  on  prototype  trainers  shall 
consist  of  all  tests  specified  herein,  and  such  additional  functional  tests 
which  may  be  required  in  accordance  with  the  detail  trainer  specification  to 
demonstrate  conformance  with  the  reference  test  criteria. 

3.1.2  Production  train^ers.-  For  production  trainers,  tests  shall  be 
conducted  from  those  specified  herein  to  demonstrate  conformance  to  the  test 
results  of  the  prototype  trainer.  The  areas  of  the  tests  to  be  conducted  are 
designated  by  an  asterisk  (*).  Additional  functional  testing  may  be  required 
in  accordance  with  the  detail  specification. 

3.2  Performance  of  tests.-  Tests  specified  herein  shall  be  conducted  by 
the  contractor,  subsequent  to  completion  of  the  quality  assurance  provisions 
of  MIL-T-23991,  and  prior  to  the  Contracting  Officer's  daily  authorized  repre- 
sentative's test  and  acceptance  program.  All  required  tests  shall  be  vali- 
dated and  certified  by  a Government  inspector.  This  certification  shall  con- 
sist of  initialing  all  original  data  sheets  used  in  the  tests.  A copy  of 
these  data  sheets  shall  be  provided  to  the  Government  inspector  by  the  con- 

\ tractor.  When  changes  or  recalibration  for  alignment,  equipment  failure,  or 

adjustment  purposes  are  made  during  the  test  programs,  such  changes  shall  be 
recorded  on  the  data  sheets.  Tests  which  may  have  been  conducted  prior  to 
such  adjustments  shall  be  repeated  unless  conclusive  proof  can  be  provided 
that  such  adjustments  have  not  invalidated  the  recorded  test  data  up  to  the 
t time  of  such  adjustments.  Upon  the  successful  completion  of  the  tests  speci- 

fied, the  trainer  shall  be  made  available  to  the  Contracting  Officer's  author- 
ized technical  representative  for  his  test  and  acceptance  program. 

3.3  Test  equipment,  programs,  and  instrumentation.-  The  contractor  shall 
supply  all  test  equipment,  programs,  and  instrumentation  necessary  to  conduct 
the  various  tests  accurately  and  expeditiously.  The  equipment  and  programs 
shall  include,  but  not  be  limited  to: 

(a)  Means  for  introducing  pulse,  step,  ramp,  and  sinusoidal  dis- 
turbances of  simulated  flight  control  surfaces  and  individual 
and  collective  cockpit  motion  axes 

I 

(b)  Equipment  for  measuring  and  recording  time,  control  deflections, 
linear  and  angular  excursions,  rates  and  accelerations,  commands 

. and  responses  of  the  motion  base.  The  accelerometers  and  rate 

gyros  shall  be  mounted  as  near  the  trainee's  head  position  as 
practical  or  shall  be  suitably  transformed  by  software  manipu- 
lation. 

(c)  Equipment  for  real-time  data  recording  of  up  to  25  variables. 
Magnetic  tape  or  disc  digital  data  recording  are  permissible 
provided  the  capability  to  record  at  the  highest  iteration  rates 
used  is  provided.  Strip  chart  recording  may  be  used  if  1/2  per- 
cent accuracy  is  available  up  to  2 Hz. 

(d)  The  capability  to  command  straight  and  level  flight  at  pre- 

^ determined  flight  conditions 

(e)  The  capability  to  individually  or  collectively  freeze  roll, 
pitch,  yaw,  x,  y,  and  z axes. 

U5 
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All  such  equipment  and  programs  shall  be  checked  or  calibrated  within  one 
month  prior  to  conducting  the  test  program.  A list  of  all  test  equipment  and 
conversion  data  shall  be  included  in  the  Government-approved  Test  Procedures 
and  Results  Report. 

3.4  Reporting  of  results.-  Test  results  shall  be  prepared  in  accordance 
with  the  following: 

3.4.1  Test  procedure  format. - 

(a)  Title  of  test  - including  subparagraph  number 

(b)  Purpose  - a statement  of  what  the  test  is  intended  to  accomplish 

(c)  Test  method  - a statement  indicating  how  the  test  is  to  be  per- 
formed, including  calculations,  formulae,  and  conversion  factors 
required  to  correlate  test  results  with  specified  test  criteria. 
When  two  or  more  quantitative  readings  are  required  simultaneously, 
the  method  of  utilizing  a plotter  or  data  recording  and  computer 
printout  shall  be  described 

(d)  Test  equipment  and  software  test  aids  required  - include  test 
points,  set-up  adjustments,  and  implementing  instructions 

(e)  Initial  conditions  - include  simulator  configuration  loadings, 
altitude,  speed,  gross  weight,  center-of-gravity,  setting  of 
controls,  and  the  like  prior  to  conducting  testing 

(f)  Additional  requirements  - discuss  personnel  required  to  conduct 
the  testing,  potential  hazards  to  personnel  performing  the 
testing,  and  the  like 

(g)  Test  procedures  - detailed  step-by-step  procedures  are  required 

(h)  Reference  aircraft  test  data  to  which  comparison  is  being  made 
superposed  with  tolerances. 

3.4.2  Test  data.-  The  simulator  test  results  data  shall  be  presented  as 
curves,  tables,  or  data  entries  as  specified  herein. 

3.4.3  Reference  data.-  Simulator  test  criteria  shall  be  specified  in 
the  detailed  trainer  specification  and  herein. 

3.4.4  Tolerances.-  All  tolerances  shall  be  in  accordance  with  the  detail 
specification;  the  tolerances  shall  be  as  specified  in  tables  Bl,  B2  & B3  if 
not  specified  in  the  detail  specification.  The  simulator  performance  shall 
equal  test  criteria  of  3.4.3  within  the  specified  tolerances. 

3.4.5  Test  grouping'.-  In  this  specification,  tests  have  been  grouped  into 
static  or  steady-state  tests  and  dynamic  or  transient  tests,  for  convenience. 

The  tests  as  performed  by  the  contractor  shall  be  sequenced  in  such  a manner  as 
to  prevent  redundancies  of  tests  and  to  permit  a maximum  amount  of  data  acquis- 
ition in  a minimum  of  time. 
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3.5  Revision  of  test  requirements.-  Requests  for  changes  (revisions, 
deviations,  or  additions)  to  requirements  specified  herein,  deemed  necessary  to 
completely  verify  the  performance  of  the  motion  platform  shall  be  presented  at 
the  time  when  the  simulation  of  the  aircraft  proposed  criteria  reports  are  sub- 
mitted for  approval.  All  such  requests  shall  be  substantiated  by  pertinent  facts, 
in  writing,  to  the  Contracting  Officer  for  approval. 

4.  INSPECTIONS  AND  TEST  PROCEDURES 

4.1  Responsibility  for  inspection.-  Unless  otherwise  specified  in  the 
contractor  or  purchase  order,  the  supplier  is  responsible  for  the  performance 
of  all  inspection  requirements  as  specified  herein.  The  Gtovernment  reserves 
the  right  to  perform  any  additional  inspections  deemed  necessary  to  assure  that 
supplies  and  services  conform  to  contracted  requirements. 

4.2  Conditions  and  configurations.-  Conditions  and  configurations  for 
cockpit  motion  system  testing  are  shown  herein. 

\ 4.2.1  Terms  and  s,yntols.-  Terms  used  herein  and  in  reoorting  results  shall 

‘ be  in  accordance  with  6.2. 

4.3  Required  testing  program.-  The  following  areas  of  cockpit  motion  system 
performance  sha'iT  be  tested  usin^  the  design  payload  weight. 

4.3.1  System  attribute  testing. - 

4. 3. 1.1  Hardware  Capabilities.-  The  tests  shown  in  table  B1  shall  be  per- 
formed to  determine  the  performance  characteristics  for  each  degree  of  freedom. 

4. 3. 1.2  Hardware  dynamic  performyce.-  The  tests  of  table  B2  shall  be  con- 
ducted recording  the  time  histories  of  the  excursions,  velocities,  and  acceler- 
ations for  each  degree  of  freedom. 

4. 3. 1.3  Simulation  attributes.-  The  conditions  of  table  B3  shall  be  evalu- 
ated separately  considering  (1)  the  basic  aerodynamic  response,  and  (2)  the 
motion  platform's  response.  The  motion  effects  (linear  and  angular  displace- 

• ments,  rates,  and  accelerations)  shall  be  recorded  as  time  history  recordings 

and  collectively  plotted  with  the  initiating  control  action,  and  the  two  areas 
mentioned  above.  The  basic  aerodynamic  response  shall  be  transferred  from  the 
simulated  center-of -gravity  to  the  trainee  sitting  position  (at  the  approximate 
' head  position  of  the  trainee)  in  accordance  with  MIL-STD-1472  via  the  appropriate 

coordinate  transformations  before  comparisons  are  made.  If  the  accelerometers 
are  not  mounted  at  the  trainee  station,  their  outputs  shall  be  appropriately 
transformed  to  the  trainee  station. 

4. 3. 1.4  Miscellaneous  tests.-  Perform  the  tests  of  table  b4. 

5.  PACKAGING.  This  section  is  not  applicable. 

6.  NOTES 

6.1  Intended  use.-  This  specification  is  intended  to  provide  the  general 
- performance  test  requirements  for  testing  cockpit  motion  systems  as  employed 

with  flight  simulators  and  to  serve  as  a basis  for  the  preparation  of  the  test 
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procedures  and  test  results  reports  which  can  be  directly  compared  with  appro- 
priate test  criteria. 

6.2  Definitions.-  Terms  and  symbols  used  throughout  this  specification 
are  defined  as  follows: 

(a)  Appurtenance  - Any  pilot-activated  device  which  disrupts  the 

equilibrium  flight  of  the  aircraft.  For  example:  Landing  gear, 

wing  flaps,  speed  brakes,  extendable  radomes,  Magnetic  Anomaly 
Detection  (MAD)  booms,  swing  wings,  and  the  like 

(b)  Configurations  - Simulated  aircraft  components  such  as  landing 
gear,  wing  flaps,  cowl  flaps,  oil  radiator  flaps  and  shutters, 
controllable  wing  slots,  gun  turrets,  blast  tube  covers,  etc., 
will  be  in  their  normal  settings  for  the  particular  configurations. 
For  aircraft  equipped  with  external  droppable  fuel  tanks,  sta- 
bility and  control  requirements  will  be  met  with  stores  both 
attached  and  removed  in  configurations  P,  CR,  L,  PA,  and  TO. 

This  statement  shall  apply  also  to  aircraft  equipped  with  other 
droppable  or  removable  external  stores,  except  that  stores  not 
intended  for  retention  during  normal  service  landings  need  not 
be  considered  in  configurations  L,  PA,  and  TO.  If  external 
fuel  tank  locations  are  not  symmetrical,  the  tanks  may  be  empty 
in  configurations  L,  PA,  and  TO 

(1)  Configuration  CR,  cruise  - Power  for  level  flight  at  approxi- 
mately the  speed  for  maximum  range,  flaps  in  cruise  position, 
and  gear  up 

(2)  Configuration  L,  Landing  - Power  off,  flaps  and  gear  down, 
or  other  high  lift  devices  at  landing  setting 

(3)  Configuration  P,  Power-on  Clean  - Normal  rated  power,  flaps 
and  gear  up 

(4)  Configuration  PA,  Power  Approach  - Power  for  level  flight 
at  1.15V  (L)  or  normal  approach  speed,  whichever  is  lower, 
flaps  and  gear  down,  other  high  lift  devices  in  normal 
approach  position 

(5)  Configuration  TO,  Take-off  - Take-off  power,  high  lift  de- 
vices and  gear  in  normal  take-off  position 

(c)  Cueing  system  - Simulation  system  designed  to  stimulate  the 
trainees  sensory  perceptors.  Cockpit  motion,  visual  display, 
g-seat,  buffet,  and  instrument  displays  are  typical  cueing 
systems. 
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Smoothness  Command  each  degree  of  freedom  Spurious  accelerations  shall  be 

with  a sinusoid  of  10%  maximum  less  than  0.04g  for  linear  degrees 
excursion  amplitude  and  0.1  Hz  of  freedom  and  l°/sec^  for  angular 
frequency  degrees  of  freedom 
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Sinusoid  Zero  to  maximum  amplitude  at  Verify  smoothness,  spurious  acceler- 

1/2  the  frequency  at  which  a 10°  ations  shall  be  less  than  O.OSg  for 
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RECOMMENDATION  FOR  SPECIFICATION  FOR 
FUNCTIONAL  TEST  REQUIREMENTS  FOR  EVALUATING 
VISUAL  DISPLAY  SYSTEMS  AS  USED  WITH 
AIRCRAFT  WEAPON  SYSTEM  TRAINERS  AND 
OPERATIONAL  FLIGHT  TRAINERS 

1 . SCOPE 

1.1  This  specification  contains  the  requirements  to  be  ful- 
filled in  evaluating  the  engineering  performance  of  visual  dis- 
play systems  as  used  with  Weapon  System  Trainers  (WST)  and  Oper- 
ational Flight  Trainers  (OFT) . The  requirements  consist  of 
tests,  test  conditions,  test  configurations,  test  methods,  and 
tolerances  to  be  met. 

2 . APPLICABLE  DOCUMENTS 

2.1  The  following  documents  of  the  issue  in  effect  on  the 
date  of  invitation  for  bids  or  request  for  proposal,  form  a part 
of  this  specification  to  the  extent  specified  herein. 

STANDARDS 

MIL-STD-150A  Military  Standard  - Photographic 

Lenses 

MIL-STD-1241A  Military  Standard  - Optical  Terms 

and  Definitions 

SPECIFICATIONS 

MIL-T-23991  Training  Devices,  Military; 

General  Specifications  for 

(Copies  of  specifications,  standards,  publications  and  drawings 
required  by  suppliers  in  connection  with  specific  procurement 
functions  should  be  obtained  from  the  procuring  activity  or  as 
directed  by  the  Procuring  Contracting  Officer.) 

2.2  Other  publications.-  The  following  documents  form  a 
part  of  this  specification  to  the  extent  specified  herein.  Un- 
less otherwise  stated,  the  issue  in  effect  on  the  date  of  request 
for  proposal  shall  apply. 

ELECTRONIC  INDUSTRIES  ASSOCIATION 

EIA-STD-343  Electrical  Performance  Standards 

for  Hi<-rh  Resolution  Monochrome 
Closed  Circuit  Television  Camera 
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(Application  for  copies  should  be  made  to  Electronic  Industries  Association, 
2001  Eye  Street,  N.W.,  Washington,  D.C.  20006.) 

INSTITUTE  OF  ELECTRICAL  AND  ELECTRONIC  ENGINEERS 

IEEE  202,  54  IRE  23,  SI  Standards  on  Television:  Methods 

of  Measurement  of  Aspect  Ratio  and 
Geometric  Distortion 

IEEE  205  Standards  on  Television:  Measurement 

of  Luminance  Signal  Levels 

(Application  for  copies  should  be  made  to  the  Institute  of  Electrical  and 
Electronic  Engineers,  345  East  47th  St.,  New  York,  N.Y.  10017.) 

(Technical  society  and  technical  association  specifications  and  standards 
are  generally  available  for  reference  from  libraries.  They  are  also 
distributed  among  technical  groups  and  using  Federal  agencies.) 

3.  REQUIREMENTS 

3.1  Application.-  The  functional  test  requirements  specified  herein 
cover  the  tests  to  be  performed,  the  test  configurations,  the  test  procedures, 
and  the  data  which  shall  be  provided.  The  requirements  provide  a uniform 
method  for  direct  comparison  of  the  visual  display  system  with  the  test 
criteria  data. 

3.1.1  Prototype  trainers.-  Tests  conducted  on  prototype  trainers  shall 
consist  of  all  tests  specified  in  4,  and  such  additional  functional  tests 
which  may  be  required  in  accordance  with  the  detail  trainer  specification 
to  demonstrate  conformance  with  the  reference  test  criteria. 

3.1.2  Production  trainers.-  For  production  trainers,  tests  shall  be 
conducted  from  4 to  demonstrate  conformance  to  the  test  results  of  the 
prototype  trainer.  The  areas  of  4 to  be  conducted  are  designated  by  an 
asterisk  (*).  Additional  functional  testing  may  be  required  in  accordance 
with  the  detail  trainer  specification. 

3.2  Performance  of  tests.-  Tests  specified  herein  shall  be  conducted 
by  the  contractor,  subsequent  to  completion  of  the  quality  assurance 
provisions  of  MIL-T-23991,  and  prior  to  the  NAVTRAEQUIPCEN  Representative's 
test  and  acceptance  program.  All  required  tests  shall  be  validated  and  certi- 
fied by  a Government  inspector.  This  certification  shall  consist  of  initial- 
ing all  original  data  sheets  used  in  the  tests.  A copy  of  these  data  sheets 
shall  be  provided  to  the  Government  inspector  by  the  contractor.  When  changes 
or  recalibration  for  alignment,  equipment  failure  or  adjustment  purposes  are 
made  during  the  test  programs,  such  changes  shall  be  recorded  on  the  data 
sheets.  Tests  which  may  have  been  conducted  prior  to  such  adjustments  shall 
be  reported  unless  conclusive  proof  can  be  provided  that  such  adjustments  have 
not  invalidated  the  recorded  test  data  up  to  the  time  of  such  adjustments. 

Upon  the  successful  completion  of  the  tests  specified,  the  trainer  shall  be 
made  available  to  the  NAVTRAEQUIPCEN  Technical  Representative  for  his  test  and 
acceptance  program. 
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3.3  Test  equipment,  programs  and  instrumentation.-  The  contractor  shall 
supply  all  test  equipment,  programs  and  instrumentation  necessary  to  conduct 
the  various  tests  accurately  and  expeditiously.  Test  equipment  and  programs 
shall  include,  but  not  be  limited  to: 

(a)  Means  for  introducing  pulse,  step,  and  sinusoidal  disturbances 
of  simulated  flight  control  surfaces 

(b)  Equipment  for  measuring  and  recording  time 

(c)  Equipment  for  real-time  data  recording  of  up  to  25  variables. 

Magnetic  tape  or  disc  digital  data  recording  are  permissable 
provided  the  capability  to  record  at  the  highest  iteration 
rates  used  is  provided.  Strip  chart  recording  may  be  used  if 
a 0.5  percent  accuracy  is  available  up  to  2 Hz 

(d)  The  capability  to  command  straight  and  level  flight  at  pre- 
determined flight  conditions 

(e)  The  capability  to  individually  and/or  collectively  freeze 
roll,  pitch,  yaw,  x,  y,  and  z axes  at  predetermined  locations 

(f)  Apparatus  for  measuring  luminance  (spot  photometer),  field  of 
view  (theodolite),  oscilloscope,  high  and  medium  resolution 
charts. 

All  such  equipment  and  programs  shall  be  checked  or  calibrated  within  one 
month  prior  to  conducting  the  test  program.  A list  of  all  test  equipment 
and  conversion  data  shall  be  included  in  the  Test  Procedures  and  Results 
Report. 

3.4  Reporting  of  results.-  Test  results  shall  be  prepared  in  accordance 
with  the  ToTTowTngl 

3.4.1  Test  procedure  format. - 

(a)  Title  of  test  - including  subparagraph  number 

(b)  Purpose  - a statement  of  what  the  test  is  intended  to 
accomplish 

(c)  Test  method  - a statement  indicating  how  the  test  is  to  be 
performed,  including  calculations,  formulae,  and  conversion 
factors  required  to  correlate  test  results  with  specified 
test  criteria.  When  two  or  more  quantitative  readings  are 
required  simultaneously,  the  method  of  utilizing  a plotter 
or  data  recording  and  computer  printout  shall  be  described 

(d)  Test  equipment  and  software  test  aids  required  - include 
test  points,  setup  adjustments,  and  implementing  instructions 

(e)  Initial  conditions  - include  simulator  configuration  loadings, 
altitude,  speed,  gross  weight,  center  of  gravity,  and  setting 
of  controls  and  the  like  prior  to  conducting  testing 
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(f)  Additional  requirements  - discuss  personnel  required  to  conduct 
the  testing,  potential  hazards  to  personnel  performing  the 
testing,  and  the  like 


(g)  Test  procedures  - detailed  step-by-step  procedures  are  required 

(h)  Reference  aircraft  test  data  to  which  comparison  is  being 
made. 

3.4.2  Test  data.-  The  simulator  test  data  shall  be  presented  as  curves, 
tables,  or  data  entries  as  specified  herein. 

3.4.3  Reference  data.-  Simulator  test  criteria  shall  be  as  specified 
herein. 


3.4.4  Tolerances.-  All  tolerances  shall  be  in  accordance  with  the  detail 
specification;  if  not  specified  in  the  detail  specification,  the  tolerances 
shall  be  as  specified  in  the  included  tables.  The  simulator  performance  shall 
equal  the  test  criteria  of  3.4.3  plus  or  minus  the  specified  tolerances. 


a 


3.4.5  Test  grouping.-  In  this  specification,  tests  have  been  grouped  into 
static  or  steady  state  tests  and  dynamic  or  transient  tests,  for  convenience. 
The  tests  as  performed  by  the  contractor  shall  be  sequenced  in  such  a manner 
as  to  prevent  redundancies  of  tests  and  to  permit  a maximum  amount  of  data 
acquisition  in  a minimum  of  time. 


3.5  Revision  of  test  requirements.-  Requests  for  changes  (revisions, 
deviations,  or  additions),  to  requirements  specified  herein,  deemed  necessary 
to  completely  verify  the  performance  of  the  visual  display  system  shall  be 
presented  at  the  time  when  the  simulation  of  the  aircraft  proposed  criteria 
reports  are  submitted  for  approval.  All  such  requests  shall  be  substantiated 
by  pertinent  facts,  in  writing,  to  the  Contracting  Officer  for  approval. 

4.  INSPECTIONS  AND  TEST  PROCEDURES 

4.1  Responsibility  for  inspection.-  Unless  otherwise  specified  in  the 
contract  or  purchase  order,  the  supplier  is  responsible  for  the  performance 
of  all  inspection  requirements  as  specified  herein.  The  Government  reserves 
the  right  to  perform  any  additional  inspections  necessary  to  assure  that 
supplies  and  services  conform  to  contracted  requirements. 


4.2  Conditions  and  configurations.-  Conditions  and  configurations  for 
visual  display  system  testing  are  shown  herein. 

4.2.1  Terms  and  symbols.-  Terms  used  herein  and  in  reporting  results 
shall  be  in  accordance  with  6.2. 

4.3  Required  testing  program.-  The  following  areas  of  visual  display 
system  performance  shall  be  tested.  Not  all  areas  are  applicable  to  all  types 
of  display  systems  and  only  those  portions  which  are  applicable  need  be 
addressed. 
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4.3.1  System  tests.-  The  following  tests  (as  applicable)  shall  be  per- 
formed for  all  types  of  visual  systems  through  the  entire  visual  generating 
and  display  system. 

4. 3. 1.1  Static  accuracy.-  The  tests  of  Table  I shall  be  conducted  to 
determine  the  static  accuracy  of  all  visual  systems. 

4. 3. 1.2  Dynamic  tests.-  The  tests  of  Table  II  shall  be  conducted  to 
determine  the  dynamic  properties  of  the  visual  system.  The  tests  shall  be 
performed  for  each  degree  of  freedom. 

4. 3. 1.3  Perspective.-  The  tests,  techniques  and  equipment  discussed  in 
Appendix  A shall  oe  used  to  verify  the  accuracy  of  the  presentation  of 
scene  perspective  and  size. 

4. 3. 1.4  Simulation  attributes.-  The  tests  of  table  III  shall  be  conducted 
to  appraise  the  simulation  attributes  of  the  displayed  scene. 

) 4. 3. 1.5  Interface  tests.-  The  tests  of  Table  IV  shall  be  conducted  to 

verify  the  interface  performance  of  the  visual  system. 

4.3.2  Display  apparatus.-  The  following  tests  apply  to  display  and 
display  related  apparatus. 

I 

4. 3. 2.1  Display  tests.-  The  tests  of  table  V shall  be  conducted  to 
verify  the  display  performance. 

4. 3.2.2  Infinity  display  optics  tests.-  The  tests  of  table  VI  shall  be 

, performed  to  verify  the  infinity  display  optics  performance. 

, 4. 3. 2. 3 Color  displays.-  The  tests  of  table  VII  shall  be  performed  to 

verify  the  color  performance  of  the  display  system. 

4. 3. 2. 4 Zoom  optics.-  The  tests  of  table  VIII  shall  be  performed  to 
verify  the  performance  of  the  zoom  optics. 

4.3.3  Model  board  tests.-  This  section  delineates  the  testing  to  be 
performed  for  model  board  type  image  generators. 

4. 3.3.1  General  parameters.-  The  tests  of  table  IX  shall  be  conducted 
to  verify  the  general  specification  parameters. 

4.3.4  Servo  performance. - The  tests  of  table  X shall  be  conducted  to 
verify  servo  performance.  The  tests  shall  be  conducted  for  all  servos  of 
the  visual  system,  i.e.,  gantry,  zoom,  model,  optical  probe,  point  light, 
sky-earth  projectors,  etc. 

4.3.5  Television  system  tests.-  The  tests  of  table  XI  shall  be  per- 
formed to  verify  performance  of  the  television  camera  and  associated 
electronic  circuitry  up  to  the  final  display  device.  The  tests  shall  be 
performed  only  if  the  performance  parameters  are  individually  specified 
in  the  detail  specification. 
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I 

4. 3. 5.1  Television  camera  systems.-  The  tests  of  table  Q2  shall  be 
performed  to  the  television  system  camera (s)  if  and  only  if  the  performance 
parameters  are  individually  specified  in  the  detail  specification. 

4.3.6  Optical  systems.-  The  tests  of  table  CL3  shall  be  performed  to 
individual  optical  systems  to  verify  their  performance.  These  tests  shall 
be  conducted  only  if  the  performance  parameters  are  individually  specified 
in  the  detail  specification. 

5.  PACKAGING.  This  section  is  not  applicable. 

6.  NOTES  I 

1 

6.1  Intended  use.-  This  specification  is  intended  to  provide  the  general  ; 

test  requirements  for  testing  synthetic  visual  display  systems  and  their  ] 

associated  equipment  as  used  with  flight  simulators  and  to  serve  as  a basis 

for  the  preparation  of  the  test  procedures  and  results  reports.  i 

) 6.2  Defini tions.-  Definitions  used  for  optical  parameters  shall  be  as 

per  MIL-STD-1241 . Definitions  for  television  parameters  shall  be  per 

EIA  Standard  RS-343.  | 

6.3  Symbols.-  The  following  symbols  are  referenced  in  Appendix  B,  test  j 

' set-ups,  and  in  table  Cl.  j 


ANG  RES 

- Angular  Resolution 

CAM 

- TV  Camera 

CCTV 

- Closed  Circuit  TV  Monitor 

CGI 

- Computer  Generated  Image 

CRT 

- Cathode  Ray  Tube 

MTF 

- Modulation  Transfer  Function 

OC 

- Observer  Camera 

OSC 

- Oscilloscope 

PHO 

- Photometer 

PROJ 

- TV  Projector 

THE 

- Theodolite 

TMB 

- Terrain  Model  Board 

TS 

- Test  Set-up  (see  figure  1) 

VSA 

- Video  Signal  Analysis 

WM 

- Waveform  Monitor. 
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TABLE  C2 . System  tests  - Dynamic  p 
TESTS  TECHNIQUE  OR  EQUIPMENT 


* 1.  Transient  response  Monitor  step  inputs  at 

host  computer/visual 
computer  interface. 
Monitor  system  response 
at  the  display  device 
output  (servos  or  de- 
flection circuits  as 
appropriate).  Step 
amplitudes  shall  be  + 

10  degrees  for  angular 
degrees  of  freedom,  and 
1000  feet  for  linear 
degrees  of  freedom. 

2.  Steady  state  time  Monitor  as  described 

lags  in  the  transient  tests. 

Excite  with  ramps  of 
1 .0%,  10%  of  maximum, 
and  maximum  velocity 
(each  DOF). 

3.  Frequency  Response  Monitor  as  described  in 

the  transient  tests. 
Excite  with  a sinusoid  of 
amplitude  1/4  maximum. 
Frequency  is  to  vary  to 
5 Hz. 


3.  Frequency  Response 


irformance. 

TOLERANCE 


No  overshoot 
allowed  greater 
than  2%,  i.e. , 
dumping  greater  than 
or  equal  to  .8.  The 
10%  settling  time 
shall  be  as  specifiec 
+ 20  msec.  (If  no 
T0%  settling  time  is 
recommended,  a 100 
msec  maximum  is 
suggested. ) 

As  specified  +10%. 

If  not  specifTed, 
recommend  lag  to 
be  less  than  60  msec. 


As  specified  + 10% 
of  amplitude  T^ot 
measured  in  dB)  and 
phase 
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TABLE  C3.  System  tests  - Simulation  attributes. 


TESTS 

TECHNIQUE  OR  EQUIPMENT 

TOLERANCE 

1. 

Scene  content 

Subjective  appraisal  of 
number  of  edges  for  CGI 
systems,  subjective  evalu- 
ation of  displayed  content 
for  other  systems. 

At  least  the  number 
of  edges  or  surfaces 
specified 

* 2. 

Scene  movement 

Subjective  appraisal  of 
smoothness  of  scene 
movement. 

No  erratic  movement 
or  jitter  shall  occur 
in  flight. 

* 3. 

Fresnel  Lens 
Optical  Landing 
System  (as 
applicable) 

At  a slant  range  of  6080 
ft,  place  the  aircraft 
"on  glide  path"  (372  ft 
plus  deck  height  for  3.5° 
glide  slope  or  425  ft 
plus  deck  height  for  4.0° 
glide  slope).  Vary  the 
height  + 80  feet  (0.75°), 
the  meatball  shall  display 
on  glide  path  and  then  + 2 
ball  heights. 

1/10  ball,  subjective 
appraisal  of  FLOLS 
size  as  a function  of 
range. 

4. 

Visual  Approach 
Slope  Indicator  - 
VASI  - (as  appli- 
cable) 

Position  the  aircraft 
on  the  glide  slope. 

Verify  white-red  lighting. 
Position  the  aircraft 
0.75°  low  on  the  glide 
slope;  verify  red-red 
lighting.  Position  the 
aircraft  0.75°  high  on  the 
glide  slope,  verify  white- 
white  lighting. 

0.1° 

5. 

Strobe  light 
operation 

Subjectively  verify  correct 
operation  of  the  strobe. 

DNA 

* 6. 

Atmospheric  Effects- 
clouds,  haze,  fog, 
etc. 

Subjective  appraisal 

DNA 

7. 

Directional  liqhts 
(as  applicable) 

Subjective  appraisal 

DNA 

8. 

Runway  markings 
(as  applicable) 

Subjective  appraisal 

DNA 

9. 

Approach  lights 
(as  applicable) 

Subjective  appraisal 

DNA 
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TABLE  C3.  System  tests  - Simulation  attributes. 

- Continued 

TESTS 

TECHNIQUE  OR  EQUIPMENT 

TOLERANCE 

10. 

Horizon  intensity 
(as  applicable) 

Subjective  appraisal 

DNA 

11. 

Beacon  light 

Subjective  appraisal 
of  color,  speed 

DNA 

12. 

Carrier  edge  lights 
(as  applicable) 

Count  and  subjective 
appraisal  of  color  and 
spacing 

As  specified,  DNA 

* 13. 

Carrier  runway 
center  lights  (as 
applicable) 

Count,  subjective  color, 
spacing  appraisal 

As  specified,  DNA 

14. 

Carrier  runway  edge 
lights  (as 
applicable) 

Count,  subjective  color, 
spacing  appraisal 

As  specified,  DNA 

15. 

Carrier  runway 
athwartships  lights 
(as  applicable) 

Count,  subjective  color, 
spacing  appraisal 

As  specified,  DNA 

16. 

Carrier  axial  deck 
bow,  athwartship 
lights  (as  appli- 
cable) 

Count,  subjective  color, 
spacing  appraisal 

As  specified,  DNA 

* 17. 

Carrier  vertical 
dropline  lights 
(as  applicable) 

Count,  subjective  color, 
spacing  appraisal 

As  specified,  DNA 

18. 

Eyeheight  above 
runway 

Subjective  appraisal 

DNA 

19. 

Mission  playback 
(as  applicable) 

Subjective  appraisal  of 
presentation  for 
specification  compliance 

Subjective  - DNA 

* 20. 

Demonstration 
maneuvers  (as 
applicable) 

Subjective  appraisal 
of  presentations 

DNA 

a.  Basic  powered 
flight  maneuvers 

b.  Ground  taxi 

c.  Takeoff  (normal 
field) 

d.  Takeoff  (catapult) 
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TABLE  C3.  System  tests  - Simulation  attributes. 
TESTS TECHNIQUE  OR  EQUIPMENT 


Continued. 

TOLERANCE 


TESTS 

TECHNIQUE  OR  EQUIPMENT 

TOLERANCE 

* 1.  Freeze 

Freeze  the  simulator. 

Subjective 

- DNA 

Verify  scene  content  to 

remain  constant. 

2.  Crash 

"Crash"  the  simulator. 

Subjective 

- DNA 

* 3.  Reset 


* 4.  Isolation 


5.  Systems  synchron- 
ization (visual, 
motion  and  instru- 
ment simulation) 


Verify  crash  presentation 
of  specification  (freeze, 
blackout,  etc.) 

Reset  the  simulator. 
Verify  original  scene 
presentation. 

Cycle  power  off  and  on 
for  visual  system. 

Verify  host  simulation  to 
be  not  interrupted  by 
power  transitions. 

Monitor  the  host-visual, 
host-motion  and  host- 
instrument  interfaces. 
Record  appropriate  axes 
on  strip  chart.  Excite 
individual  axes  of  flight 
and  compare  visual, 
motion  and  instrument 
responses  (i.e.,  motion 
position,  visual  display 
drive  and  instrument 
drive  signals.)  Instru- 
ment presentations  which 
are  normally  delayed  are 
excepted. 


Subjective  - DNA 


Subjective  - DNA 


Response  initiatior 
shall  occur  within 
20  msec  of  each 
other. 
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TABLE  C5.  System  tests  - Diselavs. 


TESTS 

* 1.  Luminance,  and 
uniformity  of 
luminance  for 
background  and 
targets. 


I * 2.  Resolution  (on  and 

j off  axis)  horizon- 

tal and  vertical. 


3.  Contrast  or  con- 
trast ratio 


4.  Depth  of  field  (not 
applicable  to  CGI 
systems) 


* 5.  Field  of  view 


6.  Geometric  distor- 
tion and  linearity 


TECHNIQUE  OR  EQUIPMENT 

Spot  photometer  used  to 
measure  luminance  at 
10°  (vertical  and  hori- 
zontal) increments  from 
pilot's  nominal  eyepoint. 

TS  - C,  I,  0 

MIL-STD-150  Resolution 
chart  (or  programmed 
version  of  the  same  for 
CGI  systems),  high  and 
medium  contrast  charts 
with  focus  set  at  normal 
setting.  Modulation 
transfer  measurement  using 
the  observer  camera  tech- 
nique or  angular  resolu- 
tion using  a theodolite 
may  be  substituted.  TS  - 
A,  E,  K 

Ratio  of  maximum  lumin- 
ance to  background 
luminance  using  spot 
photometer  for  all  display 
channels.  TS  - C,  I,  0 

MIL-STD-150A  resolution 
chart,  determine  the 
resolution  at  maximum 
range,  close  the  range 
until  the  resolution  is 
50%  of  this  value.  The 
range  difference  is  defined 
to  be  the  oepth  of  field. 

Use  theodolite  from  nominal 
pilot's  eyepoint.  TS  - D, 
J.  P 

Use  an  EIA  linearity  chart 
and  the  method  specified 
in  IEEE  202,  54IRE  23,  SI. 
TS  - D,  J,  P 


TOLERANCE 

Greater  than  mini' 
mum  specified 
value  with  corner 
luminance  no  less 
than  70%  of  cen- 
ter luminance. 

On  axis,  specifi- 
cation minimum; 
off  axis,  no  less 
than  80%  of  the 
on  axis  minimum. 


Greater  than  mini- 
mum specification 
value. 


Greater  than  the 

specification 

minimum. 


r 


Grids  within  5° 
of  optical  axis, 

6 arc  min  devia- 
tions; from  5°  to 
100°,  1%  of  ras- 
ter height; 
greater  than  100°, 
1°. 
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TABLE  C5.  System  tests  - Displays.  - Continued 

TESTS 

TECHNIQUE  OR  EQUIPMENT 

TOLERANCE 

7. 

Display  refresh 
rate 

Oscilloscope  and  photocell 

Greater  than 

specification 

minimum. 

8. 

Raster  burn 

Subjective 

Not  discernible 

* 9. 

Multiple  channel 
video  tracking  (as 
applicable) 

Use  theodolite  to  verify 
linearity  of  display  across 
boundaries  of  multiple  dis- 
play screens  as  viewed 
within  the  viewing  volume. 
TS  - D,  P 

Slope  changes 
shall  not  exceed 
the  greater  of 
1%  or  0.5°. 

* 10, 

Multiple  channel 
luminance  tracking 

Spot  photometer  each  10°  on 
adjacent  channels.  TS  - C, 
I.  0 

15% 

I 
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TABLE  C6. 

TESTS 

Infinity  display  optics  tests. 
TECHNIQUE  OR  EQUIPMENT 

TOLERANCE 

* 1.  Viewing  volume 

Measure  X,  Y,  and  Z clear 

Equal  or  better 

viewing  volume 

than  specified 

2.  Collimation 

A dioptrometer  shall  be 

^ .02  diopters  of 

3.  Mirror  tests  (as 
appl icable) 

used 

specified  value 

Radium  (spheri- 
cal mirror) 

Produce  a blur  circle: 
reflected  from  the  entire 
area  of  the  mirror  required 
to  achieve  the  specified 
field  of  view,  produced  by 
a 0.5  inch  circular  stop 
located  normal  to  and  dis- 
played orthogonally  from 
the  mirror  center  of 
curvature  by  1.0  inch 

The  maximum  blur 
circle  dimension 
composing  the  im- 
age of  the  stop, 
on  the  opposite 
side  of  the  center 
of  curvature  shall 
be  within  10%  of 
the  specified 
value 

Uniformity  of 
curvature 
(spherical 
mirror) 

Measure  any  local  variation 
in  the  radius  of  curvature 
utilizing  a ring  sphero- 
meter  sized  to  measure  the 
sagitta  to  .0005  inches 

The  radius  varia- 
tion shall  be  less 
than  0.5% 

Mirror  smooth- 
ness (spheri- 
cal ) 

Locate  an  edge  target 
(3  X 10  white  cardboard 
with  a 0.5  inch  black 
center  stripe  having  sharp 
edges)  anywhere  on  the 
focal  surface  of  the  mirror. 
Illuminate  the  target 
adequately  (50+5  foot 
lamberts  with  ambient 
lighting  less  than  10  foot 
lamberts) 

Subjective  - An 
observer  located 
at  the  approximate 
center  of  curva- 
ture shall  not  ob- 
serve the  reflex 
image  of  the  edge 
to  have  any  wavi- 
ness (caused  by 
surface  ripples) 
or  feathery  rag- 

gedness  (orange 
peel  effect)  or 
any  other  irregu- 
larity using  only 
the  unaided  eye. 


I 

I 


J 
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TABLE  C7. 

Display  tests  - Color  Performance. 

TESTS 

TECHNIQUE  OR  EQUIPMENT 

TOLERANCE 

* 1 . Convergence 

Dot  and  colorbar  generator 

In  a circular  area 

or  grid  pattern  target 

of  diameter  .8 
times  picture 
height  conver- 
gence error  shall 
be  less  than  0.1% 
of  picture  height. 
In  a circular 
area  whose  dia- 
meter is  equal  to 
the  height,  the 

convergence  error 
shall  be  less 
than  0.2%.  In  the 
remaining  corner 
area,  the  error 
shall  be  less 
than  0.5%. 

2.  Color  capability 

Display  system  capability. 

Better  than  speci- 

Using  a colorimeter,  evaluate 
and  compare  to  detail  specifi- 
cation requirements 

fi cation  value 

* 3.  Color  tracking  (as 

Colorimeter  evaluation  of 

DNA 

applicable) 

color  tracking  (from  screen 
to  screen  for  multiple 
screen  systems  or  through- 
out a single  screen  for 
large  displays 
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TESTS 


TABLE  C8 . Display  tests  - Zoom  optics. 
TECHNIQUE  OR  EQUIPMENT 


TOLERANCE 


1.  Magnification 

Material  and  techniques 
are  described  in  Appendix 
A 

5% 

* 2,  Optical  Axis  Shift 

Place  a paint  target  on 

Target  shift  shall 

the  optical  axis  with  the 

not  exceed  5 arc 

zoom  optics  at  the  minimum 
zoom  configuration.  Acti- 
vate the  zoom  to  the  maxi- 
mum zoom  configuration, 
monitor  the  change  in 
position  of  the  target. 

minutes 

TABLE  C9.  Model  board  tests  - General  Parameters 


TESTS 


1 . Texture 

2.  Color 

3.  Illumination 


4.  Dimensions  (over- 
all) 


TECHNIQUE  OR  EQUIPMENT 


Subjective  evaluation  of 
final  viewed  scene  for 
appropriateness  of  scene 
texture  and  seams 

Subjective  evaluation  of 
final  viewed  scene  for 
appropriateness  of  natural 
color  presentation 

Measure  illumination  of 
the  model  board  every  8 
feet  in  X and  Y 

Measure  model  board  over- 
all dimensions 


TOLERANCE 


DNA 


Better  than  speci- 
fied minimum 


0.5  feet 
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TABLE 

TESTS 

CIO.  Servo  Tests. 
TECHNIQUE  OR  EQUIPMENT 

TOLERANCE 

*1 . Excursion  limits 

Command  full  excursion, 
monitor  feedback  device 

Equal  to  or  greater 
than  specified 

2.  Velocity  limits 

Step  input 

Equal  to  or  greater 
than  specified 

3.  Acceleration 

Step  input  or  sinu- 

Equal  to  or  greater 

limits 

soidal  input 

than  specified 

*4.  Static  accuracy 
(positional) 

Command  position,  monitor 
feedback  device  (if  one 
is  used)  or  measure 
response.  Command  to 
include  1/4,  1/2,  3/4 
maximum. 

.15%  of  command 

5.  Repeatability 

Command  same  position 

.02%  of  initial 

approaching  the  position 
from  either  side 

cotinand 

6.  Dynamic  accuracy 

Command  ramp  inputs  of 

Response  amplitude 

(velocity  tracking) 

1/100  maximum  and  1/2 
maximum  rate.  Monitor 
positional  and  rate 
feedback  devices 

shall  be  within  10% 
of  command.  Velocity 
fluctuations  shall 
be  less  than  2%  of 
command 

*7.  Transient  response 

Command  step  input  of 
the  lesser  of  1/10 
maximum  excursion  or 
30°.  Use  velocity  step 
for  velocity  servos 

Damping,  .1  of 
specified  value; 
natural  frequency, 
.2  Hz  of  specified. 
If  not  specified, 
recommend  .7^1 
damping,  25+3 
radians  per  second 
frequency 

8.  Frequency  response 

Obtain  Bode  plots  of 
amplitude  and  phase 

0 to  1 Hz,  2db,  10° 

1 Hz  to  2 Hz,  4db, 
20° 

2 Hz  to  5 Hz, 

8db,  40° 

9.  Reset  speed 

Activate  reset  from 
various  origins.  Monitor 
speed 

10%  of  specified. 
If  not  specified, 
10  inches/sec 
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TABLE  Cll.  Television  system  tests  (to  be  perfomed  only  if 
specified  in  the  detail  specificati^ 


TESTS 

TECHNIQUE  Ok  EQUIPMENT 

TOLERANCE/COMMENT 

Bandwidth 

Necessary  bandwidth  = 1.5  N/T 
where  N/T  = Total  picture  ele- 
ments (Black  and  White)  trans- 
mitted per  sec  = number  of 
lines  forming  each  image  x 
elements  per  line  x pictures 
transmitted  per  second.  Band- 
width to  be  measured  at  3 
decibels  down  from  peak 

Specification 
value  + 5 MHz. 

If  not  specified, 
recommend  1 . 5 N/T 
at  + 3dB  down 

Ganfma 

Within  10%  of 
specified  or 
unity  if  not 
specified 

Signal  to  noise 

Ratio  of  RMS  signal  to  RMS 
noise 

Specification 
value  + 2dB.  If 
not  specified, 
recommend  40  dB 

Resolution 

MIL-STD-150  resolution  chart, 
high  and  medium  contrast 
charts  with  focus  set  at 
normal  setting.  Angular 
resolution  using  a theodo- 
lite or  MTF  may  be  substi- 
tuted. 

Greater  than 
specified.  If 
not  specified, 
recommend  700  TV 
lines  minimum  in 
center,  550  in 
corners. 

■V 


144 


NAVTRAEQUIPCEN  IH-251 


TABLE  C12.  Television  camera  tests  (performed 

only  if  test 

areas 

are  specified  in  the  detail 

specification). 

TESTS 

TECHNIQUE  OR  EQUIPMENT 

TOLERANCE/COMMENT 

1.  Geometric  Dis- 
tortion 

Specified  in  IEEE  202, 
IRE  23. SI,  Standards  on 
television:  Methods  of 

measurement  of  Aspect 
Distortion 

2%  of  picture  height 

2.  Resolution 

Specified  in  IEEE  208, 

60  IRE  23. S2,  Standards 
on  Video  Techniques: 
Measurement  of  Resolution 
of  Camera  Systems 

Per  table  I of  EIA 
Standard  RS-343-A, 
Electrical  Perfor- 
mance Standards  for 
High  Resolution 
Monochrome  Closed 
Circuit  Television 
Camera 

3.  Gray  Scale 

Per  EIA  Standard  RS-343-A 

All  ten  steps  of  the 
EIA  resolution  chart 
shall  be  visible 

4.  Luminance 

Per  IEEE  Std  205 

Detail  specification 
values  + 5% 

TABLE  C13.  Optical  system  tests  (only  as  specified  in  the 

detail 

specification). 

TESTS 

TECHNIQUE  OR  EQUIPMENT 

TOLERANCE/COMMENT 

1 . Image  size 

All  tests  of  this  section 
to  be  performed  per  MIL- 
STD-150A  for  all  lens 
systems  used  in  the  dis- 
play system 

All  tolerances  re- 
quired for  this 
section  are  to  be 
supplied  in  the 
Detail  Specifica- 
tion 

2.  Entrance  pupil 
size  and  position 

3.  Depth  of  field 

4.  Focal  length 
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STATIC  AND  PERSPECTIVE  ACCURACY  TESTING 


1.  Referring  to  the  test  configuration  of  Figure 0.4,  select  a rectangular 
viewing  target  such  as  a landing  field,  carrier  deck,  or  artifically  introduced 
target  such  as  a 3 X 5 card  (model  board  systems)  or  a programmed  rectangle, 
such  that  all  the  designated  angles  remain  in  the  field  of  view  provided  by 
the  visual  system  under  test. 


The  angles 

shown  in  Figure 

C14  are 

defined 

as 

follows: 

01  = Tan-^ 

h 

1 

’J'l 

= Tan-i 

w/2 

(L  + Xi) 

^ (L 

+ Xi^)  + hi^ 

02  = Tan-^ 

Hi 

'i'2 

= Tan-^ 

w/2 

Xi 

1^  + hi^  1 

03  = Tan-^ 

H2 

= Tan-^ 

w/2 

(L  + X2) 

+ X2  ) + h2^ 

04  = Tan-i 

h 

1 

'I'lt 

= Tan-i 

w/2 

3.  Verify  the  static  and  perspective  accuracy  of  the  visual  presentation 
by  positioning  the  simulated  aircraft  to  the  locations  of  table  ci4  and 
determining  the  pitch,  width,  and  presentations  required. 
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Target  near  NA  NA  NA  Rotate  A/C  about  the 

right  corner  body  axes  64  about  Y,  1/J4 

about  1.  Target  near 
right  corner  shall  appear 
on  display  center  line. 


PERSPECTIVE  ACCURACY  TESTING  DISPLAY 


HORIZON 
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